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ABSTRACT 


This  research  is  designed  to  examine  the  impact  of  academic  assistance  programs 
at  the  United  States  Naval  Academy  on  at-risk  students.  Each  year,  a  percentage  of 
students  at  the  United  States  Naval  Academy  are  enrolled  in  an  academic  assistance 
program  known  as  the  Plebe  Intervention  Program.  This  program  is  only  offered  to  those 
students  who  are  deemed  at-risk  and  susceptible  to  academic  difficulties.  Another 
academic  assistance  program  that  is  offered  is  known  as  the  Midshipmen  Group  Study 
Program.  This  program,  which  is  voluntary  and  offered  to  all  students  at  the  United 
States  Naval  Academy,  is  based  on  the  supplemental  instruction  model  that  was 
developed  at  the  University  of  Missouri-Kansas  City. 

This  study  analyzes  the  impact  of  each  form  of  academic  assistance  in 
determining  the  likelihood  of  student  progression  beyond  the  freshman  year.  Students 
who  represent  the  most  at-risk  students  at  the  United  States  Naval  Academy  are 
compared  against  students  with  similar  entrance  characteristics.  This  study  hypothesizes 
that  student  participation  in  each  of  the  academic  assistance  programs  correlates  to 
persistence.  In  addition,  this  study  hypothesizes  that  student  participation  in  the 
Midshipmen  Group  Study  Program  leads  to  higher  persistence  rates  among  at-risk 
students  than  those  who  merely  participate  in  the  Plebe  Intervention  Program. 

Results  of  the  study  indicate  that  participation  in  the  Midshipmen  Group  Study 
Program  leads  to  an  increase  in  academic  perfonnance  and  higher  persistence  rates  than 
those  students  who  do  not  participate.  In  addition,  students  enrolled  in  the  Plebe 
Intervention  Program  are  no  less  likely  to  attrite  during  their  freshman  year  than  students 
with  similar  entrance  characteristics  that  are  not  enrolled  in  the  Plebe  Intervention 
Program. 
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I.  INTRODUCTION 


A.  BACKGROUND 

Despite  the  fact  that  the  United  States  Naval  Academy  is  a  military  institution,  it 
faces  many  of  the  same  concerns  of  its  private  and  public  counterparts.  Chiefly, 
however,  the  Naval  Academy  is  responsible  to  the  public  and  maintains  the  responsibility 
of  preparing  its  graduates  for  service  in  our  nation’s  armed  forces.  If  the  Naval  Academy 
does  not  achieve  its  graduation  goals,  it  stands  the  risk  of  weakening  national  security 
and  wasting  taxpayer  money.  Graduates  from  the  Naval  Academy  are  expected  to 
assume  leadership  positions  within  the  Navy  and  Marine  Corps  immediately  upon  their 
graduation. 

Each  year,  admissions  requirements  at  the  Naval  Academy  are  based  upon  the 
need  for  junior  officers  in  the  operating  forces.  Due  to  the  nature  of  officer  accessions, 
there  does  not  exist  the  possibility  of  simply  “hiring”  another  junior  officer  if  a  Naval 
Academy  Midshipman  is  unable  to  complete  his  or  her  academic  requirements.  As  a 
result,  Midshipman  retention  and  attrition  are  two  issues  that  are  very  important  to  the 
Naval  Academy. 

Attrition  at  the  Naval  Academy  is  the  result  of  a  number  of  factors.  Two  reasons 
for  which  students  attrite  at  the  Naval  Academy  are  academic  deficiencies  and  voluntary 
disenrollment.  Although  there  are  other  reasons  for  which  a  student  might  attrite 
(medical,  conduct,  professional,  etc.),  the  focus  of  this  study  is  on  persistence  at  the 
Naval  Academy. 

Traditionally,  students  who  are  admitted  to  the  Naval  Academy  have 
demonstrated  exceptional  academic  achievement  throughout  their  high  school  careers. 
Despite  this,  many  are  under  prepared  for  the  academic  rigors  at  the  Naval  Academy. 
While  all  are  admitted  based  on  the  belief  that  they  will  succeed  academically,  it  is  also 
assumed  that  all  students  will  require  some  sort  of  academic  assistance  during  their  time 
at  the  Naval  Academy  (Academic  Dean  Instruction  1531.34A). 

Like  most  colleges  and  universities  throughout  the  country,  the  Naval  Academy 
has  also  had  to  institute  academic  assistance  programs  in  order  to  combat  attrition  and 
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low  academic  achievement.  In  1989,  the  Naval  Academy  formally  addressed  academic 
attrition  by  instituting  a  formalized  academic  assistance  organization.  This  organization, 
known  as  the  Academic  Center,  is  responsible  for  the  management  and  oversight  of  the 
various  academic  assistance  programs  employed  at  the  Naval  Academy.  Programs 
offered  at  the  Academic  Center  range  from  one-on-one  instruction  (tutoring)  to  student- 
led  study  sessions. 

Two  academic  assistance  programs  that  are  administered  by  the  Academic  Center 
are  the  Plebe  Intervention  Program  and  the  Midshipmen  Study  Group  Program. 
Although  each  is  a  form  of  developmental  education  and  whose  aim  is  Midshipmen 
retention,  each  is  very  different  from  the  other. 

1.  Plebe  Intervention  Program 

As  previously  mentioned,  every  Midshipman  is  admitted  to  the  Naval  Academy 
under  the  premise  that  he  or  she  will  be  able  to  complete  the  academic  requirements. 
Despite  this,  the  Naval  Academy  carefully  analyzes  the  personal  records  of  each  admitted 
Midshipman  in  order  to  detennine  the  likelihood  of  academic  success.  As  a  result  of  this 
process,  a  number  of  students  are  identified  as  possessing  the  individual  characteristics 
that  will  make  them  most  susceptible  to  academic  difficulty.  These  students  are  enrolled 
in  a  program  known  as  the  Plebe  Intervention  Program  (PIP).  Once  enrolled  in  PIP, 
students  are  assigned  an  academic  advisor  and  enrolled  in  study  skills  classes.  This 
program  represents  a  proactive  approach  by  the  Naval  Academy  to  identify  those  who  are 
more  likely  to  attrite  and  to  provide  early  intervention  for  them. 

2.  Midshipmen  Group  Study  Program 

The  second  program  that  will  be  the  focus  of  this  study  is  the  Midshipmen  Group 
Study  Program  (MGSP).  This  program,  which  is  based  on  the  Supplemental  Instruction 
model  developed  at  the  University  of  Missouri-Kansas  City,  provides  student-led  study 
sessions  in  courses  that  have  traditionally  been  academically  challenging  to  Midshipmen 
(Blanc,  Debuhr,  &  Martin,  1983).  Unlike  PIP,  this  program  is  completely  voluntary. 

There  exists  considerable  debate  within  the  developmental  education  community 
concerning  the  most  effective  form  of  academic  assistance.  While  some  argue  that  study 
skills  based  courses  like  PIP  are  appropriate  for  developing  generic  skills  among 

students,  others  argue  that  content  specific  assistance  programs  (MGSP)  are  more 
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successful.  Although  this  study  explores  the  differences  between  the  two  programs,  the 
emphasis  of  the  study  focuses  on  an  at-risk  student’s  persistence  beyond  his  or  her 
freshman  year. 

Perhaps  the  most  widely  discussed  explanation  of  a  student’s  decision  to 
participate  in  additional  academic  assistance  is  motivation.  As  a  variable,  motivation  is 
difficult  to  analyze.  In  many  studies,  motivation  has  not  been  analyzed  because  the  focus 
has  been  on  quantitative  data.  This  study  attempts  to  measure  an  at-risk  student’s 
motivation  to  participate  in  a  voluntary  academic  assistance  program  through  a  voluntary 
survey  designed  to  measure  motivation  and  determine  the  correlation  with  persistence. 


B.  PURPOSE 

The  overall  objective  of  this  thesis  is  to  measure  the  impact  of  academic 
assistance  programs  on  a  student’s  persistence  beyond  his  or  her  freshman  year.  The 
outcome  variable  to  be  analyzed  will  be  attrition  during  a  student’s  freshman  year.  By 
exploring  the  independent  variables  that  correlate  to  persistence,  the  Naval  Academy  can 
better  recruit  potential  applicants.  In  addition,  this  study  will  determine  the  most  suitable 
academic  assistance  program  for  at-risk  students.  This  will  allow  the  Naval  Academy  to 
develop  academic  assistance  programs  to  suit  the  needs  of  at-risk  students. 

C.  RESEARCH  QUESTIONS 

•  What  are  the  differences  between  students  selected  for  inclusion  in  the  PIP 
as  opposed  to  those  assigned  to  the  watch-list? 

•  What  is  the  impact  of  selected  academic  assistance  programs  on  whether 
or  not  an  at-risk  student  attrites  at  the  Naval  Academy  during  his  or  her 
freshman  year? 

•  Do  students  solely  enrolled  in  PIP  perfonn  better  in  selected  courses  than 
other  PIP  students  who  also  participate  in  MGSP? 

•  What  is  the  impact  of  motivation  on  the  performance  of  at-risk  students? 

D.  BENEFITS  OF  THE  STUDY 

This  study  will  allow  the  Naval  Academy,  and  in  particular  the  Academic  Center 
to  better  develop  academic  assistance  programs  designed  to  meet  the  needs  of  at-risk 
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students.  In  addition,  this  study  will  effectively  evaluate  the  perfonnance  differences 
between  students  enrolled  in  PIP  and  MGSP. 


E.  SCOPE  AND  METHODOLOGY 

The  focus  of  this  study  is  to  determine  the  characteristics  of  at-risk  students  who 
led  to  their  persistence  or  attrition  at  the  Naval  Academy.  Data  were  collected  on  at-risk 
Midshipmen  from  year  groups  2005-2008.  This  group  was  selected  because  they  are  still 
in  attendance  at  the  Naval  Academy  during  this  research  and  allowed  for  qualitative  data 
collection. 

A  combination  of  quantitative  and  qualitative  analysis  was  conducted  as  part  of 
this  research.  Quantitative  data  were  collected  on  participants  that  were  detennined  to  be 
at-risk  from  2005-2008.  Qualitative  data  analysis  was  conducted  using  a  survey  to 
measure  motivation  of  PIP  participants  from  2005-2008. 

F.  ORGANIZATION 

This  thesis  is  divided  into  five  chapters.  Chapter  II  reviews  the  development  of 
academic  assistance  programs  designed  to  improve  academic  performance  and  curb 
attrition  at  post-secondary  institutions  across  the  United  States.  Chapter  II  also  outlines 
the  current  academic  assistance  programs  being  utilized  at  the  United  States  Naval 
Academy.  Chapter  III  describes  the  methodology  used  in  the  collection  and  analysis  of 
data  for  the  study.  Chapter  IV  presents  the  results  of  the  quantitative  and  qualitative 
analysis.  Chapter  V  provides  conclusions  and  recommendations  based  on  the  analysis  of 
the  data. 
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II.  LITERATURE  REVIEW 


A.  THE  DEVELOPMENTAL  LEARNER  AND  COLLEGE  ATTRITION 

As  more  Americans  are  admitted  to  institutions  of  higher  learning,  the  need  for 
academic  assistance  programs  has  increased  dramatically.  Despite  the  fact  that  students 
meet  all  admissions  criteria,  institutions  have  discovered  that  many  college  freshmen  are 
academically  under  prepared  when  they  arrive.  As  a  result,  many  students  fail  to  succeed 
academically  and  are  not  allowed  to  continue  their  education.  In  addition,  some  students 
experience  such  academic  difficulty  that  they  do  not  choose  to  reenroll.  In  both  cases, 
the  loss  of  revenue  for  the  institution  is  dramatic.  Tuition  fees  are  the  most  obvious  loss 
of  revenue  for  the  school  when  a  student  withdraws,  but  there  are  other  associated  costs 
that  are  also  lost  such  as  housing.  As  a  result  of  these  concerns,  many  schools  have 
implemented  academic  assistance  programs  in  order  to  better  prepare  a  student  for 
academic  rigors  and  increase  the  chance  of  a  students’  persistence  to  graduate. 

B.  ATTRITION  AND  THE  INSTITUTION’S  DILEMMA 

The  1998  National  Center  for  Education  Statistics  reported  that  37  percent  of 
beginning  postsecondary  students  failed  to  complete  any  degree  and  were  not  enrolled  in 
any  academic  program  after  five  years  (National  Center  for  Education  Statistics,  1998). 
College  attrition  has  become  the  focus  of  many  college  administrators  due  to  a  number  of 
reasons.  In  public  and  private  institutions,  attrition  among  their  students  results  in  loss 
of  revenue  and  loss  of  prestige  (Blanc,  DeBuhr,  Martin,  1983;  Congos  &  Schoeps,  1997). 

C.  ATTRITION:  THE  IMPACT  OF  ACADEMIC  PERFORMANCE 

In  the  past,  studies  have  indicated  that  this  high  attrition  rate  directly  corresponds 
to  a  student’s  poor  academic  performance,  particularly  in  large  entry-level  courses 
(Daugherty  &  Lane,  1999;  Blanc,  Debuhr,  &  Martin,  1983).  To  improve  retention  rates 
and  curb  attrition,  many  schools  have  implemented  programs  designed  to  improve  the 
academic  success  of  their  students  (Patrik,  J,  Furlow,  J.W.,  &  Donovan,  S,  1988;  Tinto, 
1987;  Noel  et  ah,  1985).  In  the  past,  academic  assistance  programs  were  operated  on  a 
drop-in  basis.  Students  who  were  experiencing  academic  difficulty  would  seek  out 
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assistance.  This  is  a  reactive  approach  and  depends  on  the  students’  self-awareness  and 
willingness  to  seek  assistance.  Schools  began  to  realize  that  some  students  who  were 
experiencing  academic  difficulty  were  reluctant  to  seek  assistance.  Oftentimes,  these 
students  were  those  who  failed  to  persist  (Blanc,  Debuhr,  &  Martin,  1983).  To  combat 
this  problem,  many  schools  began  developing  academic  assistance  programs  in  the  mid- 
1980s  that  were  of  a  proactive  nature  and  sought  to  identify  students  before  they 
experienced  academic  difficulty  (Blanc,  Debuhr,  &  Martin,  1983). 

School  administrators  are  also  faced  with  the  dilemma  that  many  students 
admitted  are  under  prepared  for  the  rigors  of  post-secondary  education.  Of  all  first-year 
students  in  college,  nearly  one-third  require  remedial  education  in  reading,  writing,  or 
mathematics.  This  has  led  to  the  development  of  numerous  academic  assistance 
programs  at  colleges  and  universities  throughout  the  country.  These  programs  have  been 
implemented  for  a  number  of  reasons.  One  reason  for  this  is  that  college  students  are  not 
self-regulated  learners  (Simpson,  Hynd,  Nist,  &  Burrell,  1997).  Students  have  difficulty 
analyzing  tasks,  synthesizing  information,  monitoring  their  understanding  of  course 
material,  and  developing  strategies  for  remembering  what  they  have  learned  (Simpson,  et 
ah,  1997).  It  is  for  this  reason  that  academic  assistance  programs  have  flourished 
throughout  college  campuses  across  the  country  (Simpson,  et  ah,  1997).  This  need  for 
remediation  is  growing  and  many  students  will  require  substantial  remediation  to  meet 
graduation  requirements  (Bettinger  &  Long,  2004). 

1.  At-risk  Students 

At-risk  students  pose  other  problems  for  administrators  in  the  development  of 
academic  assistance  programs.  Research  indicates  that  at-risk  students  are  less  inclined 
to  self-select  participation  in  academic  assistance  programs  than  non-at-risk  students.  In 
addition,  at-risk  students  are  also  less  inclined  to  continue  to  participate  once  enrolled 
(Blanc,  Debuhr,  &  Martin,  1980;  Friedlander,  1980;  Karabenick  &  Knapp,  1988). 
Furthermore,  the  behavioral  changes  desired  as  a  result  of  the  assistance  programs  are  not 
lasting  (Dembo  &  Seli,  2004). 

2.  Combating  the  Reluctant  Learner 

Many  schools  attempt  to  encourage  participation  in  assistance  programs.  Despite 
the  encouragement,  studies  show  that  in  many  cases  no  amount  of  encouragement  will 
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increase  student  participation  (Hodges,  2001).  Research  indicates  that  there  may  be  a 
number  of  reasons  for  these  phenomena:  first,  at-risk  students  need  stronger  external 
influences  to  facilitate  positive  changes  in  their  behavior.  Second,  at-risk  students  may 
have  unrealistic  perceptions  about  their  academic  abilities.  In  other  words,  they  do  not 
believe  that  they  need  assistance  (Hodges,  2001). 

D.  ACADEMIC  ASSISTANCE  PROGRAMS:  ALTERNATIVES 

1.  Developmental  Education 

Over  the  past  two  decades,  there  has  been  considerable  emphasis  on  learning 
strategies  of  at-risk  students.  As  institutions  develop  assistance  programs  to  combat 
attrition  and  improve  perfonnance,  increasingly  more  emphasis  has  been  placed  on  the 
needs  of  the  students  as  the  point  of  departure  in  the  development  of  such  programs.  This 
new  emphasis  on  academic  assistance  has  led  to  increased  emphasis  on  developmental 
education.  Developmental  education  is  a  field  of  practice  and  research  within  higher 
education  with  a  theoretical  foundation  in  developmental  psychology  and  learning  theory 
(National  Association  for  Developmental  Education  {NADE},  2005).  According  to  the 
National  Association  for  Developmental  Education,  the  definition  of  developmental 
education  is: 

Developmental  education  is  a  field  of  practice  and  research  within  higher 
education  with  a  theoretical  foundation  in  developmental  psychology  and  learning 
theoiy.  It  promotes  the  cognitive  and  affective  growth  of  all  postsecondary  learners,  at 
ail  levels  of  the  learning  continuum.  Developmental  education  is  sensitive  and 
responsive  to  individual  differences  and  special  needs  among  learners. 

Developmental  education  programs  and  sendees  commonly  address  academic 
preparedness,  diagnostic  assessment  and  placement,  development  of  general  and 
discipline-specific  learning  strategies,  and  affective  barriers  to  learning. 

Developmental  education  includes,  but  is  not  limited  to: 

-all  forms  of  learning  assistance,  such  as  tutoring,  mentoring,  and 
supplemental  instruction 

-personal,  academic,  and  career  counseling 
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-academic  advisement 


-coursework 

This  revolutionary  approach  to  academic  assistance  indicates  a  new  emphasis  on 
instituting  a  variety  of  assistance  programs  based  on  the  needs  of  the  student. 
Traditionally,  academic  assistance  was  available  only  when  a  student  voluntarily 
participated.  Oftentimes,  a  student  only  participated  after  experiencing  academic 
difficulty.  In  this  approach,  however,  there  exist  additional  methods  for  identification  of 
students  more  prone  to  academic  difficulty.  More  importantly,  this  approach  realizes  that 
not  one  approach  is  suitable  for  all  students. 

Despite  the  challenges  that  colleges  and  universities  face  in  developing  academic 
assistance  programs,  many  schools  have  chosen  to  offer  alternatives.  Rather  than  offer  a 
single  academic  assistance  program,  many  schools  offer  various  forms  of  academic 
assistance  in  an  attempt  to  meet  the  needs  of  their  students. 

2.  Remedial  Courses 

Developmental  education  typically  includes  such  activities  as 
remedial/developmental  courses,  tutoring,  learning  laboratories,  and  other  forms  of 
personalized  instruction  (National  Association  for  Developmental  Education,  2005).  Of 
all  the  types  of  developmental  education,  the  programs  that  spark  the  most  debate  are 
remedial  programs  (Boylan,  1999).  There  are  a  number  of  reasons  that  remedial 
programs  are  often  criticized.  First,  the  cost  of  administering  such  courses  creates  a  fiscal 
burden  on  the  schools  that  choose  to  implement  them.  Second,  remedial  courses  take  far 
too  long  and  delay  students  from  completing  their  degree  because  these  are  oftentimes 
non-credit  courses.  As  a  result,  participation  in  such  courses  can  extend  a  student’s  time 
at  a  school  up  to  one  year  (Boylan,  1999). 

Remedial  courses  are  but  one  form  of  developmental  education  aimed  at 
improving  the  performance  of  students.  There  are  other  forms  of  developmental 
education  that  can  accomplish  the  same  goals  as  remediation  without  the  associated  costs 
in  term  of  money  and/or  time  investment. 
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3.  Tutoring 

Tutoring  has  long  since  been  a  staple  as  a  developmental  education  program.  Its 
success  is  undeniable.  Studies  indicate  that  tutoring  has  a  positive  impact  on  retention 
and  graduation,  course  grades,  course  completion  rates,  and  student  attitudes  toward 
instruction  (Boylan,  Bonham,  Claxton,  &  Bliss,  1992).  It  should  be  noted,  however,  that 
successful  tutoring  programs  often  include  a  very  directive  and  comprehensive  tutor 
training  program  (Boylan,  Bliss,  &  Bonham,  1997). 

Tutoring  is  an  academic  assistance  program  that  is  generic.  That  is,  it  teaches 
strategies  and  techniques  that  are  not  particular  to  a  single  course  (Simpson,  et  ah,  1997). 

4.  Freshman  Seminars 

At  most  colleges  and  universities,  students  attend  an  orientation  prior  to  the 
commencement  of  classes.  These  orientations  typically  last  between  two  to  three  days 
and  focus  on  the  rules  and  regulations  of  the  institution.  Many  educators,  however,  are 
rethinking  the  role  of  the  freshman  seminar.  Rather  than  provide  a  comprehensive 
orientation  at  the  beginning  of  the  year,  many  educators  espouse  a  freshman  orientation 
program  that  takes  place  throughout  the  year  (Boylan,  1999).  Many  schools  even  offer 
the  freshman  orientation  as  a  full-credit  course  (Boylan,  1999).  The  purpose  of  such  a 
program  is  to  expose  the  students  less  to  the  rules  and  regulations,  and  more  to  the  issues 
they  face  in  college.  Among  these  issues  are  retention,  expectations,  and  purpose  of 
higher  education.  While  the  freshman  orientation  does  not  lead  to  the  development  of 
learning  skills,  it  is  effective  at  introducing  college  issues  and  easing  the  adjustment  of 
newly-arrived  students  (Fidler  &  Goodwin,  1994). 

5.  Learning  Communities  and  Collaborative  Learning 

Research  has  shown  that  college  retention  is  positively  related  to  a  student’s 
membership  in  various  college  academic  clubs  (Astin,  1993).  As  such,  there  exists  an 
increased  effort  at  many  institutions  to  offer  students  the  opportunity  to  be  part  of  such 
communities.  The  premise  of  such  a  program  is  that  the  strongest  community  that  most 
students  will  encounter  while  in  college  exists  in  the  classroom  (Boylan,  1999).  Based  on 
this,  the  emphasis  of  such  a  program  is  the  development  of  relationships  within  the 
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classroom  that  create  a  sense  of  group  learning.  In  essence,  students  in  such  a  learning 
community  learn  collectively,  rather  than  in  isolation  (Boylan,  1999). 

6.  Learning  to  Learn  Courses 

In  Learning  to  Leam  Courses,  students  are  taught  learning  strategies  that  can  be 
employed  in  a  variety  of  courses.  Learning  to  learn  courses  emphasize  a  developmental 
approach  rather  than  a  deficient  approach.  Students  are  not  singled  out  for  their 
deficiencies.  Rather,  a  developmental  approach  is  introduced  that  is  effective  in  a  variety 
of  courses.  Cognitive  aspects  of  learning  and  practical  tips  are  introduced.  In  such 
courses,  topics  might  include:  learning  from  reading,  learning  from  discussion,  problem 
solving  and  creativity,  writing,  and/or  test- taking  strategies.  In  learning-to-learn  courses, 
specific  emphasis  is  placed  upon  a  student’s  ability  to  self-monitor  his  or  her 
performance.  Although  these  types  of  courses  are  offered  throughout  the  country, 
research  indicates  that  teaching  study  skills  without  a  particular  content  focus  has  little 
impact  on  a  student’s  academic  performance  (Martin  &  Arendale,  1993). 

E.  SUPPLEMENTAL  INSTRUCTION  (SI) 

1.  Origins 

Another  academic  assistance  program  that  has  been  developed  is  known  as  SI. 
This  program  was  created  by  Dr.  Deanna  Martin  at  the  University  of  Missouri  Kansas 
City  in  1973.  Currently,  SI  is  one  of  only  a  few  remediation  programs  designated  by  the 
United  States  Department  of  Education  (USDOE)  as  an  Exemplary  Educational  Program 
(Center  for  Supplemental  Instruction,  1997).  In  addition,  SI  is  the  only  program 
identified  by  USDOE  as  improving  student  academic  perfonnance  and  graduation 
(Center  for  Supplemental  Instruction,  1997). 

Supplemental  Instruction,  originally  developed  by  the  Student  Learning  Center 
(SLC)  at  the  University  of  Missouri  Kansas  City  (UKMC),  represents  a  fundamentally 
different  approach  to  combat  high  attrition  rates  (Center  for  Supplemental  Instruction, 
1997).  Rather  than  focus  on  at-risk  students,  SLC  focused  on  courses  that  traditionally 
produced  some  of  the  lowest  grades  by  students.  The  SLC  identified  high-risk  courses  as 
those  in  which  30  percent  of  the  students  received  a  “D”  or  “F,”  or  withdrew  from  the 
course  (Blanc,  DeBuhr,  &  Martin,  1983).  Initially,  SI  was  only  offered  in  the  health 
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science  professional  schools,  but  was  extended  throughout  the  school  after  success  was 
realized.  Once  a  course  was  identified,  the  SLC  designed  an  academic  assistance 
program  that  focused  on  mastering  course  specific  content,  rather  than  an  individual’s 
special  needs  (Blanc,  Debuhr,  &  Martin,  1983). 

SI  is  an  academic  assistance  program  that  utilizes  an  embedded  approach 
(Simpson  et  ah,  1997).  In  this  approach,  specific  strategies  and  techniques  are  introduced 
that  apply  only  to  a  particular  course.  In  such  an  approach,  the  emphasis  is  on  the 
thinking  process  associated  with  mastery  of  a  particular  course.  General  study  skills  are 
not  introduced.  Although  SI  specifically  targets  a  students’  mastery  of  specific  course 
content,  it  also  develops  reading,  reasoning,  and  study  skills  (Blanc,  DeBuhr,  &  Martin, 
1983). 

2.  Characteristics  of  SI 

Supplemental  Instruction  focuses  on  high-risk  courses,  rather  than  on  high-risk 
students  (Blanc,  Debuhr,  &  Martin,  1983).  In  the  design  of  such  a  program,  this  is  an 
important  aspect.  Rather  than  single  out  a  particular  student  or  group,  a  course  is 
identified  as  being  the  difficulty.  This  eliminates  any  stigma  among  the  students  who 
might  be  present  if  the  emphasis  were  on  the  individual.  Any  student  in  the  targeted 
course  is  eligible  to  participate  in  the  program— not  just  those  with  academic  difficulty. 
This  has  an  enormous  impact  on  participation.  Whereas  tutoring  involves  individual 
instruction,  SI  is  characterized  by  group  learning.  As  a  result,  students  more  often 
selected  to  participate  in  SI  rather  than  tutoring  (Hodges,  2001). 

As  high-risk  courses  are  identified  (introductory  classes  in  which  30  percent  or 
more  of  the  students  enrolled  received  grades  of  “D,”  “F,”  or  “W”),  students  are  hired 
who  have  taken  the  course  and  received  an  “A”  grade.  These  students  serve  as  leaders 
and  are  financially  compensated  for  their  participation.  After  receiving  training  in  group 
dynamics  and  facilitation,  the  leaders  attend  all  classes  and  complete  the  same 
assignments  as  those  regularly  enrolled  in  the  course.  The  SI  attendees  are  made  aware 
of  this  in  an  attempt  to  strengthen  the  bond  between  the  leader  and  the  student  (Congos  & 
Schoeps,  1993).  To  the  students,  the  leader  is  viewed  as  “student  of  the  subject”  (Blanc, 
DeBuhr,  &  Martin,  1983).  That  is,  they  serve  as  an  example  for  the  students  to  emulate 

based  on  their  knowledge,  curiosity  in  the  subject,  and  professionalism.  Although  the 
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leader  is  routinely  viewed  as  an  expert  in  the  subject,  the  fact  that  he  or  she  is  also  a 
student  reduces  the  stigma  associated  with  academic  remediation.  The  leader  works 
closely  with  the  professor  and  provides  valuable  feedback.  Oftentimes,  the  professor 
alters  the  course  based  on  the  feedback  from  the  SI  leader. 

Central  to  a  student’s  success  in  a  particular  course  is  his  or  her  understanding  of 
the  academic  tasks  that  will  be  encountered.  It  is  only  after  a  thorough  understanding  of 
the  tasks  that  a  student  can  develop  the  thinking  processes  required  to  produce  the  results 
desired  by  the  instructor  (Simpson  et  al.,  1997).  Because  of  the  close  linkage  between  the 
SI  leader  and  the  professor,  this  is  easily  accomplished.  In  essence,  the  student’s 
understanding  of  the  course  equates  to  the  professor’s  understanding  of  the  course 
through  the  mediation  of  the  SI  leader. 

3.  Frequency  of  SI  Sessions 

SI  sessions  are  typically  held  three  times  per  week.  Each  session  is  approximately 
one  hour  in  duration.  Students  typically  attend  one  session  per  week.  In  terms  of 
effectiveness  of  the  program,  most  researchers  indicate  that  students  must  attend  at  least 
five  SI  sessions  during  a  given  semester  to  maximize  their  success  in  the  program  (Martin 
et  al.  1993). 

4.  Focus  of  an  SI  Session 

The  SI  sessions  are  not  merely  a  review  of  the  course  lectures.  Rather,  SI  leaders 
discuss  topics  that  are  generated  by  the  students.  It  is  the  role  of  the  SI  leader  to  identify 
course  difficulties,  provide  strategies  for  dealing  with  the  complexities,  and  determine  the 
best  manner  in  which  the  course  content  can  be  learned. 

The  atmosphere  within  the  SI  session  is  marked  by  group  understanding  and 
problem  solving.  Oftentimes,  students  collectively  arrive  at  solutions  to  problems.  As  the 
SI  leader  poses  questions  to  the  group,  the  group  is  required  to  solve  the  problem  by 
using  various  fonns  of  thinking,  reasoning,  analyzing,  and  organizing.  In  other  words, 
the  SI  leader  is  attempting  to  develop  cognitive  skills  within  the  students.  As  previously 
mentioned,  it  is  these  skills  that  many  entry-level  students  lack  and  that  often  block  the 
learning  process  at  the  undergraduate  level  (Congos  &  Schoeps,  1993). 
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5.  Development  of  Learning  and  Thinking  Skills 

Central  to  leaders’  responsibilities  is  the  development  of  the  students’  learning 
and  thinking  skills.  These  skills,  which  are  vital  for  content  mastery,  are  largely 
underdeveloped  in  college  freshmen  (Blanc,  DeBuhr,  &  Martin,  1983).  Rather  than 
analyze  and  synthesize  problems,  college  freshmen  are  more  inclined  and  comfortable 
focusing  on  rote  memorization  and  superficial  details.  It  is  for  this  reason  that  the  leader 
is  attentive  to  these  needs. 

In  addition  to  developing  these  cognitive  skills,  the  leader  focuses  on  a  student’s 
mastery  of  the  course  content.  As  a  regular  participant  in  each  of  the  classes,  the  leader  is 
in-tune  with  the  course  progression.  As  a  result,  the  leader  can  effectively  lead 
discussions  and  review  assignments.  In  addition,  the  leader  is  able  to  introduce 
alternative  techniques  to  realize  course  mastery  such  as  note-taking  techniques,  reading 
techniques,  mnemonics,  and  test-taking  strategies  (Blanc,  DeBuhr,  &  Martin,  1983). 

6.  Implementing  SI 

As  previously  discussed,  SI  is  voluntary  program.  Despite  this,  many  institutions 
advertise  SI  in  an  attempt  to  increase  participation  (Blanc,  DeBuhr,  &  Martin,  1983; 
Congos  &  Schoeps,  1993).  SI  leaders  are  presented  as  “masters”  of  the  course.  In 
addition,  the  leaders  are  purported  to  possess  successful  strategies  specific  to  the  course 
in  which  SI  is  being  offered.  Ultimately,  however,  students  are  informed  that 
participation  in  the  program  will  yield  better  grades. 

7.  Role  of  the  Professor 

For  SI  to  be  an  effective  academic  assistance  program  for  a  particular  course,  the 
professor  must  be  an  active  participant  in  the  process.  The  professor  must  encourage 
student  attendance  at  SI  sessions  to  master  the  course  content  (Martin  et  ah,  1993). 

In  addition,  the  professor  must  be  willing  to  work  closely  with  the  SI  leader.  This 
requires  full  disclosure  to  the  SI  leader  of  course  materials,  exams,  and  lesson  plans. 
Professors  must  also  be  willing  to  meet  periodically  with  SI  leaders  to  evaluate  program 
effectiveness  (Martin  et  ah,  1993). 
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8.  SI  Leaders 

The  success  of  an  SI  program  is  dependant  on  the  quality  of  the  individual  leaders 
(Congos  &  Schoeps,  1993).  There  are  two  primary  methods  for  developing  SI  leaders 
that  create  an  ideal  learning  environment:  selection  and  training  (Martin  et  ah,  1993). 

SI  leaders  must  have  demonstrated  academic  excellence  throughout  all  aspects  of 
the  curriculum,  not  merely  the  course  he/she  is  attempting  to  lead.  SI  leaders  must 
possess  a  “B”  average  in  all  courses  and  earned  an  “A”  in  the  specific  course  in  which 
he/she  will  lead.  In  addition  to  this  demonstrated  academic  excellence,  particular 
attention  must  be  given  to  an  individual’s  interpersonal  skills.  Research  indicates  that 
students  in  an  SI  group  who  do  not  like  their  leader  do  not  do  as  well  as  those  in  other 
groups  who  do  like  the  leader  (Congos  &  Schoeps,  1993). 

Although  intelligence  and  interpersonal  skills  are  requirements  of  SI  leaders,  there 
must  still  be  an  extensive  training  program  for  every  SI  leader.  Typically,  training  for  SI 
leaders  consists  of  a  series  of  seminars  prior  to  the  commencement  of  the  class,  and 
continues  throughout  the  semester  during  weekly  meetings  with  course 
coordinators/administrators.  During  these  weekly  meetings,  specific  problems  and 
strategies  are  discussed  for  implementation  in  future  SI  sessions  (Congos  &  Schoeps, 
1993). 

F.  RESULTS  OF  SI  PROGRAMS 

At  UMKC  and  other  institutions,  SI  has  achieved  tremendous  success  (Blanc, 
DeBuhr,  &  Martin,  1983;  Congos  &  Schoeps,  1993,  Congos  &  Schoeps,  1993,  Hodges, 
2001).  Studies  have  indicated  that  Si-students,  when  compared  to  non-SI  students, 
maintain  higher  grade  point  averages  (GPA)  despite  having  lower  entry-level  data  (Blanc, 
DeBuhr,  &  Martin,  1983;  Congos  &  Schoeps,  1993).  In  multiple  studies  on  the 
effectiveness  of  SI,  researchers  have  shown  that  SI  students  in  the  highest  and  lowest 
quartiles  of  entry  tests  produced  better  academic  performance  than  non-SI  participants  in 
the  same  quartiles  (Blanc,  DeBuhr,  &  Martin,  1983;  Congos  &  Schoeps,  1993,  Congos  & 
Schoeps,  1993). 
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Table  1  is  the  result  of  an  analysis  on  grades  and  withdrawal  rates  of  students  who 
participated  in  Si-targeted  courses  at  UMKC  from  1980-1999.  The  results  of  the  analysis 
indicate  that  SI  students  earned  a  higher  percentage  of  “A”  and  “B”  grades,  lower 
percentage  of  “D”  &  “F”  grades  and  withdrawals,  and  higher  mean  final  course  grades 
than  non-SI  participants  (Center  for  Supplemental  Instruction,  2000). 
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Table  1.  SI  UMKC  Data:  FY  1980-81  to  1998-99 
(N=525  SI  Courses;  19,962  Si-Participants;  31,368  Non-SI  Participants) 


Year 

SI  Participant 

Status 

SI  Participation  Percent 

and  Number 

Number  of 

SI  Courses 

Percent  “A” 

and  “B” 

Percent  “D,” 

“F,”  and 

Withdrew 

Final 

Course 

Grade 

1998-1999 

SI 

48.9(2,010) 

52 

54.4 

20.2 

2.70 

Non-SI 

51.1  (2,044) 

42.9 

33.8 

2.43 

1997-1998 

SI 

39.4(1,700) 

51 

55.1 

19.0 

2.65 

Non-SI 

60.6  (2,606) 

42.8 

36.5 

2.31 

1996-1997 

SI 

45.4(1,604) 

47 

55.9 

16.7 

2.66 

Non-SI 

54.6(1,929) 

44.1 

31.5 

2.35 

1995-1996 

SI 

40.0(1,454) 

41 

52.0 

21.6 

2.64 

Non-SI 

60.0(2,181) 

37.8 

39.6 

2.27 

1994-1995 

SI 

36.3  (1,328) 

41 

52.6 

20.8 

2.84 

Non-SI 

63.7  (2,330) 

39.6 

36.0 

2.69 

1993-1994 

SI 

38.1  (1,233) 

40 

49.0 

23.1 

2.52 

Non-SI 

61.9(2,003) 

37.1 

38.2 

2.18 

1992-1993 

SI 

37.0  (1,287) 

36 

55.6 

20.7 

2.84 

Non-SI 

63.0(2,191) 

41.6 

37.3 

2.50 

1991-1992 

SI 

39.5  (1,520) 

27 

56.4 

19.2 

2.69 

Non-SI 

60.5  (2,328) 

41.5 

34.1 

2.16 

1990-1991 

SI 

34.1  (774) 

18 

53.4 

16.0 

2.61 

Non-SI 

65.9(1,496) 

38.7 

31.2 

2.23 

1989-1990 

SI 

30.3  (753) 

19 

58.3 

16.7 

2.70 

Non-SI 

69.7  (1,732) 

41.9 

34.8 

2.29 

1988-1989 

SI 

29.9  (614) 

17 

63.2 

15.6 

2.81 

Non-SI 

70.1(1,439) 

45.7 

28.9 

2.39 

1987-1988 

SI 

34.5  (775) 

24 

60.4 

13.7 

2.80 

Non-SI 

65.9(1,498) 

43.8 

28.9 

2.39 

1986-1987 

SI 

44.3  (778) 

19 

56.3 

18.3 

2.65 

Non-SI 

55.7  (978) 

40.9 

34.1 

2.41 

1985-1986 

SI 

39.1  (584) 

16 

51.5 

18.7 

2.55 

Non-SI 

60.9(910) 

51.2 

28.7 

2.34 

1984-1985 

SI 

42.6  (788) 

17 

59.7 

16.8 

2.83 

Non-SI 

57.4(1,062) 

42.9 

25.4 

2.27 

1983-1984 

SI 

34.1  (765) 

19 

54.5 

17.3 

2.76 

Non-SI 

65.9(1,478) 

39.5 

29.5 

2.24 

1982-1983 

SI 

43.1  (1,119) 

19 

52.2 

17.9 

2.51 

Non-SI 

56.9(1,477) 

36.8 

28.2 

2.07 

1981-1982 

SI 

40.9  (329) 

5 

58.2 

20.9 

2.61 

Non-SI 

59.1  (475) 

38.5 

26.7 

2.09 

1980-1981 

SI 

32.2  (566) 

17 

50.1 

14.2 

2.56 

Non-SI 

67.8  (1,192) 

32.5 

33.1 

2.16 

From  Center  for  Supplemental  Instruction  (2000) 
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Success  at  UMKC  cannot  be  debated.  Studies  conducted  by  the  Center  for 
Supplemental  Instruction  also  indicate  that  the  findings  at  UMKC  are  consistent  with 
other  schools  across  the  country  (Center  for  Supplemental  Instruction,  2000).  Table  2 
examines  national  data  from  270  institutions  from  across  the  country  between  1982  and 
1996. 


Table  2.  National  SI  Field  Data:  FY  1982-1983  to  1995-1996 
N=270  Institutions;  4,945  Courses;  505,738  students 


Student 

Grades 

All  Institutions 

N=4,945 

Two-Year 

Public 

N=931 

Two-Year 

Private 

N=20 

Four-Year 

Public 

N=3,001 

Four-Year 

Private 

N=994 

Final  Course 

SI 

2.42 

2.56 

2.55 

2.36 

2.55 

Grade 

Non-SI 

2.09 

2.09 

2.26 

2.07 

2.31 

Percent  A  &  B 

SI 

46.8 

53.1 

53.1 

53.1 

53.1 

Final  Grade 

Non-SI 

35.9 

32.4 

38.9 

38.9 

43.2 

Percent  D,  F, 

SI 

23.1 

24.3 

24.6 

24.6 

19.1 

and  W  Final 

Grade 

Non-SI 

37.1 

32.4 

31.5 

31.5 

28.4 

From  Center  for  Supplemental 


nstruction  (2000) 


Table  2  reflects  findings  from  academic  institutions  from  across  the  United  States 
that  are  similar  to  those  discovered  at  UMKC.  SI  participants  earned  a  higher  final 
course  grade,  had  a  higher  percentage  of  “A”  and  “B”  grades,  and  received  less  “D,”  “F,” 
and  “W”  final  grades  than  non-SI  participants.  These  findings  are  consistent  for  both  the 
majority  as  well  as  minority  students  (Blanc,  DeBuhr,  &  Martin,  1983). 

Despite  the  documented  success  of  SI,  early  intervention  remains  crucial  to 
improving  student  performance.  If  students  delay  participation  in  the  program  until  later 
in  the  semester,  they  rarely  achieve  the  same  level  of  success  as  those  who  participate 
from  the  very  beginning  of  the  semester.  If  a  student  experiences  academic  difficulty  as 
early  as  the  six-week  point  in  a  semester,  the  chances  are  low  that  any  academic 
assistance  will  be  effective  (Martin  et  al.  1993). 

1.  SI  and  Technical  Courses 

Success  of  Si-participating  students  applies  to  both  liberal  arts  courses  and  more 
technically  oriented  courses.  To  institutions  such  as  the  Naval  Academy,  which  offer  a 
highly  technical  curriculum,  this  is  a  particularly  compelling  reason  to  pursue  such  a 
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program.  Analysis  of  over  270  institutions  from  across  the  country  show  that  SI- 
participating  students  performed  better  than  non-SI-participating  students  in  courses  such 
as  calculus,  chemistry,  engineering,  and  physics  as  shown  in  Table  3. 


Table  3.  National  SI  Field  Data:  FY  1982-83  to  1995-1996 
N=270  Institutions;  4,  4945  Courses;  505,738  Students 

Data  Separated  by  Academic  Departments 


Types  of  Courses 

Percent  “A”  and  “B” 

(chi-square  test) 

Percent  “D,”  “F,”  and 

“W”  (chi-square  test) 

Final  Course  Grade 

(independent  t-test) 

All  Courses 

SI 

46.8 

23.1 

2.42 

N=4,945 

Non-SI 

35.9 

37.1 

2.10 

p-value 

0.01 

0.01 

0.01 

Calculus 

SI 

43.1 

32.4 

2.26 

N=143 

Non-SI 

37.2 

42.5 

2.06 

p-value 

0.05 

0.05 

0.01 

Chemistry 

SI 

46.2 

23.2 

2.40 

N=718 

Non-SI 

36.9 

36.5 

2.08 

p-value 

0.05 

0.05 

0.01 

Engineering 

SI 

37.8 

33.3 

2.16 

N=63 

Non-SI 

30.0 

44.2 

1.91 

p-value 

0.05 

0.05 

0.01 

Physics 

SI 

45.1 

24.4 

2.42 

N=129 

Non-SI 

35.9 

36.9 

2.02 

p-value 

0.05 

0.05 

0.02 

From  Center  for  Supplemental  Instruction  (2000) 


G.  REASONS  FOR  SI  SUCCESS 

Since  its  inception,  SI  has  been  considered  a  highly  effective  academic  assistance 
program.  Studies  have  proven  that  SI  effectiveness  is  undeniable  (Blanc,  DeBuhr,  & 
Martin,  1983,  Congos  &  Schoeps,  1993,  Congos  &  Schoeps,  1993,  Hodges,  2001). 
There  are  a  number  of  reasons  for  which  this  has  occurred.  First  and  foremost,  students 
who  attend  SI  do  not  have  the  stigma  that  they  are  deficient.  Rather,  the  course  is 
targeted.  Second,  SI  is  effective  at  improving  the  academic  performance  of  students  from 
various  subpopulations.  Regardless  of  academic  preparation,  gender,  age,  ethnicity, 
academic  discipline,  or  whether  or  not  a  student  works  has  not  been  found  to  significantly 
impact  the  effectiveness  of  SI  (Martin  &  Arendale,  1993,  Center  for  Supplemental 
Instruction,  1997). 
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SI  is  geared  toward  content-specific  skills,  rather  than  generic  learning  strategies. 
While  learning  strategies  are  taught,  they  are  geared  toward  the  specific  course  in  which 
SI  is  offered.  As  a  result,  students  are  developing  knowledge  in  specific  area  while 
simultaneously  developing  effective  learning  strategies. 

H.  FINANCIAL  IMPLICATIONS 

The  cost  for  colleges  and  universities  to  offer  academic  remediation  programs  is 
high.  At  public  institutions  alone,  an  estimated  $  1  billion  is  spent  on  remedial  programs 
(Maxwell,  1992).  This  cost  has  led  many  to  question  whether  or  not  remedial  programs 
should  be  offered.  Some  states  (e.g.,  Connecticut  and  Arizona)  do  not  allow  remediation 
at  their  public  institutions  (Maxwell,  1992).  Other  states  have  chosen  to  restrict 
remediation  to  only  its  two-year  institutions.  In  addition,  some  states  have  placed  the 
financial  burden  on  the  student’s  former  high  school.  In  some  states  (e.g.,  Minnesota  and 
Virginia),  high  schools  are  held  accountable  for  their  student’s  preparedness  (Maxwell, 
1992).  In  these  cases,  the  costs  associated  with  a  student’s  remedial  programs  are  billed 
directly  to  the  high  school  (Maxwell,  1992). 

Despite  the  costs  associated  with  academic  remedial  programs,  the  fact  is  that 
there  are  under  prepared  students  who  are  enrolled  in  our  colleges  and  universities. 
Many  schools  now  faced  with  the  burden  of  financing  such  academic  remediation 
programs  are  seeking  more  cost-effective  programs  to  address  their  student’s  needs 
(Maxwell,  1992). 

At  the  same  time,  SI  remains  the  most  cost  effective  remedial  program  available 
to  institutions  because  the  leaders  do  not  receive  monetary  compensation.  Rather  than 
hire  tutors,  SI  allows  schools  to  “pay”  tutors  (leaders)  in  academic  credits.  The  cost 
effectiveness  of  such  programs  far  outweighs  the  traditional  approach  (Maxwell,  1992). 

I.  METHODOLOGICAL  DIFFICULTIES 

1.  Student  Differences 

Although  many  studies  indicate  that  SI  is  a  successful  alternative  to  traditional 
academic  assistance,  there  are  difficulties  associated  with  evaluating  the  effectiveness  of 
the  program.  Many  researchers  have  postulated  that  attendees  of  SI  sessions  represent  a 
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different  type  of  student:  dedicated,  motivated,  and  ambitious  (Congos  &  Schoeps, 
1993).  Therefore,  it  is  difficult  to  compare  non-SI  students  to  SI  students  because  it  is 
assumed  that  the  SI  students  possess  many  positive  characteristics  that  are  not  common  in 
non-SI  students.  In  other  words,  the  success  of  the  program  may  not  be  due  to  the 
program,  but  simply  due  to  the  fact  that  the  students  who  self-select  have  superior 
abilities  (Congos  &  Schoeps,  1993).  This  self-selection  bias  is  addressed  throughout  the 
research  and  many  researchers  have  attempted  to  deal  with  it  through  qualitative  methods 
of  evaluation. 

2.  What  to  Analyze? 

Another  problem  in  evaluating  the  effectiveness  of  such  academic  assistance 
programs  is  identifying  the  outcome  variable  to  be  analyzed.  While  many  researchers 
analyze  such  variables  as  test  scores,  final  course  grades,  and  GPAs,  others  have  argued 
that  more  qualitative  measurements  must  be  used  due  to  the  subtle  factors  that  affect  a 
student’s  academic  experience,  such  as  work  status,  socialization,  and  athletic  status 
(Congos  &  Schoeps,  1993).  In  such  cases,  a  student’s  experiences  may  vary  based  on 
time  demands  and  ability  to  concentrate  solely  on  academic  requirements. 

3.  Participation 

Finally,  many  studies  differ  on  their  definition  of  an  SI  participant.  In  some 
studies,  a  student  is  viewed  as  an  SI  participant  if  he  or  she  attended  one  session.  It  is 
arguable,  however,  that  a  student  who  only  attends  a  single  session  is  benefiting  from  the 
program  (McCarthy  &  Smuts,  1997). 

4.  Student  Motivation 

Student  motivation  has  been  identified  as  a  critical  predictor  of  a  student’s 
academic  success,  yet  it  is  difficult  to  measure  (Simpson,  et  ah,  1997).  The  significance 
of  motivation  cannot  be  understated.  Students  who  possess  motivation  are  more  likely  to 
employ  self-regulating  strategies  that  improve  their  academic  performance  (Simpson,  et 
ah,  1997).  Studies  also  indicate  that  students  who  do  not  possess  motivation  are  less 
likely  to  persist  in  their  coursework  (Simpson,  et  ah,  1997).  In  addition,  they  lack  the 
fortitude  to  adequately  respond  to  academic  setbacks  and  are  more  inclined  to  accept 
academic  difficulty  and  mediocrity  (Simpson,  et  ah,  1997). 
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J.  MEASURING  MOTIVATION 

As  discussed,  student  motivation  is  another  confounding  variable  in  research 
examining  the  effectiveness  of  SI  because  it  is  difficult  to  measure.  For  example,  some 
studies  at  UKMC  have  attempted  to  analyze  motivation,  but  failed  to  differentiate 
between  motivation  to  excel  in  coursework  and  motivation  to  participate  in  academic 
assistance  programs.  Many  researchers  indicate  a  need  for  better  methods  to  analyze  the 
effects  of  motivation  in  studies  examining  the  effectiveness  of  SI  (e.g.,  Congos  & 
Schoeps,  1993;  McCarthy  &  Smuts,  1997). 

Although  students  who  are  assigned  to  developmental  education  programs  are 
considered  less  academically  capable  than  their  peers,  they  also  may  possess  individual 
characteristics  that  prevent  them  from  achieving  academic  excellence.  As  more  and  more 
research  on  developmental  education  is  being  conducted,  there  is  increasingly  more 
evidence  that  certain  students  possess  less  academic  motivation  and,  as  a  result,  are  less 
likely  to  achieve  academic  excellence  (Morrison,  1999). 

At  many  institutions,  student  motivation  is  measured  using  the  College  Student 
Inventory  (CSI).  Currently,  over  500  institutions  across  the  country  utilize  the  CSI  as  an 
early  intervention  tool  to  assist  at-risk  students.  The  CSI  is  used  to  identify  which 
students  in  the  freshman  population  are  most  in  jeopardy  of  academic  difficulty  and 
attrition.  Based  on  the  results  of  the  self-reported  survey,  institutions  can  provide  early 
intervention  and  devise  personalized  academic  assistance  programs. 

The  CSI  is  comprised  of  194  items  contained  in  17  different  scales.  The  survey  is 
organized  in  live  main  categories:  academic  motivation,  social  motivation,  general 
coping  skills,  receptivity  to  support  services,  and  initial  impression  of  the  institution 
(Noel  &  Levitz,  1985). 

Although  many  schools  utilize  the  CSI  to  measure  motivation  and  identify  at-risk 
students,  many  other  schools  utilize  the  Learning  and  Study  Strategies  Inventory 
(LASSI).  The  LASSI  is  an  inventory  of  a  students’  self-awareness  about  the  use  of 
learning  and  study  strategies  related  to  skill,  will,  and  self-regulation  components  of 
strategic  learning  (LASSI  website,  2005).  The  outcome  of  a  student’s  responses  to  the 
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80-item  inventory  can  lead  to  early  intervention  and  a  personalized  academic  assistance 
program. 

K.  ACADEMIC  ASSISTANCE  PROGRAMS  AT  THE  UNITED  STATES 

NAVAL  ACADEMY 

1.  The  Academic  Center 

To  provide  academic  support  to  the  Brigade  of  Midshipmen,  the  United  States 
Naval  Academy  established  the  Academic  Center  in  1989.  The  mission  of  the  Academic 
Center  is  to  “support  the  mission  of  the  Naval  Academy  by  providing  the  highest  quality 
academic  support  programs  for  the  entire  Brigade  of  Midshipmen.”  (Academic  Center, 
2003).  The  goals  of  the  Academic  Center  are: 

•  Provide  excellent  academic  support  services  for  all  Midshipmen  so  that 
they  are  able  to  work  to  their  highest  potential  in  a  rigorous  educational 
environment. 

•  Teach  basic  learning  skills  necessary  for  effective  academic  performance. 

•  Encourage  active,  independent  learning. 

The  initial  impetus  to  establish  such  an  organization  was  a  report  generated  by  the 
Minority  Midshipmen  Study  Group  that  indicated  the  need  for  a  proactive  academic 
support  program  for  academically  challenged  Midshipmen.  In  its  infancy,  the  Academic 
Center  focused  primarily  on  the  identification  and  remediation  of  academically 
substandard  Midshipmen.  Over  the  years,  however,  the  scope  of  the  Academic  Center’s 
focus  has  broadened.  Currently,  the  Academic  Center  offers  a  host  of  academic  support 
programs  to  meet  the  needs  of  the  entire  Brigade  of  Midshipmen. 

Located  in  Ward  Hall  at  the  Naval  Academy,  the  Academic  Center  is  staffed  by 
full-time  employees,  hourly  employees,  faculty  members,  and  Midshipmen.  The  director 
of  the  Academic  Center  supervises  four  program  directors,  one  full-time  reading  and 
learning  instructor,  one  full-time  tutor,  six  departmental  liaisons,  and  approximately  85 
Midshipmen  study  group  leaders. 

2.  Academic  Center  Programs 

To  meet  its  goals,  the  Academic  Center  administers  four  programs:  Academic 
Counseling  Programs,  Learning  Skills  Programs,  Plebe  Programs,  and  Tutoring 
Programs.  Although  each  program  will  be  discussed,  the  focus  of  this  study  will  be  the 
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Plebe  Programs  and  the  Tutoring  Programs.  Information  on  each  of  these  programs  was 
obtained  through  various  sources.  The  following  is  a  list  of  sources  from  which  this 
research  is  based: 

•  Academic  Dean  Instruction  1531.56J.  (2004)  United  States  Naval 

Academy.  Plebe  Advising  Handbook. 

•  Annual  Report  of  the  Academic  Center  (2002-2003),  United  States  Naval 
Academy 

•  Midshipmen  Groups  Study  Program  (n.d.)  Retrieved  Jan  13,  2005  from 
World  Wide  Web:  http://usna.edu/MGSP/become  a  leader.htm 

•  United  States  Naval  Academy  Academic  Center  (2005,  Feb  12)  Retrieved 
Feb  12,  2005  from  the  World  Wide  Web:  http://www.usna.edu/AcCenter/ 

•  United  States  Naval  Academy  Academic  Dean  and  Provost  Instruction 
1531.34A:  Academic  Support  Programs.  25  Aug  92 

•  Interview,  Director  of  Plebe  Programs,  Academic  Center,  8  Dec  04 

•  Interview,  Director,  Midshipmen  Group  Study  Program,  Academic 
Center,  10  Dec  04 

a.  Academic  Counseling  Program 

The  Academic  Counseling  Program  is  designed  to  improve  the  academic 
performance  of  upper-class  Midshipmen.  Following  a  Midshipmen’s  Plebe  academic 
year,  he/she  may  be  assigned  to  participate  in  the  Academic  Counseling  Program  based 
on  past  academic  performance.  There  are  two  programs  within  the  Academic  Counseling 
Program  to  which  a  Midshipman  may  be  assigned.  Category  I  is  designed  for 
Midshipmen  who  do  not  have  a  quality  point  ratio  (QPR)  above  a  2.0  or  are  two  courses 
behind  in  their  matrix.  Midshipmen  assigned  to  this  program  are  assigned  an  academic 
advisor  from  the  Academic  Center  and  are  mandated  to  meet  periodically  with  the 
advisor.  Each  year,  approximately  60  Midshipmen  are  selected  to  participate  in  this 
program.  Category  II  is  designed  for  Midshipmen  who  have  a  history  of  academic 
difficulty,  but  have  a  QPR  above  a  2.0.  These  Midshipmen  are  assigned  an  academic 
advisor  from  the  major  department  with  whom  they  can  meet.  The  performance  of 
Category  II  Midshipmen  is  monitored  by  the  Academic  Center.  Approximately  50 
Midshipmen  are  selected  to  participate  in  this  program  annually. 
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b.  Learning  Skills  Program 

The  Learning  Skills  Program  consists  of  three  programs  designed  to 
improve  academic  perfonnance  of  all  Midshipmen  by  developing  and/or  refining  learning 
skills.  Each  semester,  approximately  200  Midshipmen  self-select  to  participate  in  this 
program.  All  programs  offered  through  the  Learning  Skills  Program  are  available  to  all 
Midshipmen,  not  merely  those  experiencing  academic  difficulty.  The  three  programs 
offered  through  the  Learning  Skills  Program  are:  Learning  Skills  Course,  Individual 
Learning  Skills  Sessions,  and  Training  Workshops.  All  of  these  courses  focus  on 
improving  a  Midshipman’s  learning  skills  through  the  introduction  and  application  of 
such  topics  as  time  management  strategies,  note  taking  skills,  test  taking  strategies,  and 
stress  management.  The  most  significant  difference  between  the  various  programs  is  the 
ratio  of  instructor  to  student.  For  example,  in  the  Individual  Learning  Skills  Sessions,  a 
Midshipman  is  provided  with  one-on-one  instruction.  In  all  other  programs,  however, 
there  are  multiple  students  participating  in  the  courses. 

c.  Plebe  Programs 

There  are  two  primary  programs  offered  to  incoming  Midshipmen  at  the 
Naval  Academy:  the  Plebe  Intervention  Program  and  the  Plebe  Advising  Program. 
These  programs  are  designed  to  assist  incoming  Midshipmen  to  adjust  to  the  academic 
rigors  of  the  Naval  Academy.  Although  the  Plebe  Advising  Program  offers  services  to 
all  incoming  Midshipmen,  the  Plebe  Intervention  Program  is  designed  to  assist  those 
incoming  Midshipmen  who  have  been  determined  to  have  a  greater  potential  for 
academic  difficulty. 

d.  Plebe  Advising  Program 

The  Plebe  Advising  Program  is  offered  to  all  incoming  Midshipmen.  This 
program  offers  basic  instruction  in  learning  skills  strategies  in  an  informal  setting.  Each 
year,  two  academic  advisors  are  assigned  to  each  company  within  the  Brigade  of 
Midshipmen  who  are  available  for  academic  assistance  and  guidance.  These  advisors 
typically  assist  the  Plebes  in  matters  such  as  course  registration,  major  selection,  and 
general  academic  assistance.  Although  the  frequency  in  which  a  Plebe  will  meet  with 
his/her  advisor  may  vary,  it  is  the  goal  of  the  institution  for  advisors  to  meet  with  each 
Plebe  at  least  three  times  each  semester. 
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e.  Plebe  Intervention  Program 

While  the  Plebe  Advising  Program  is  offered  to  all  incoming  Midshipmen, 
the  Plebe  Intervention  Program  (PIP)  is  only  offered  to  those  incoming  Midshipmen  who 
have  been  identified  as  possessing  characteristics  that  make  them  susceptible  to  academic 
difficulties  at  the  Naval  Academy.  Plebes  assigned  to  this  program  are  provided  with 
periodic  academic  counseling  by  advisors  from  the  Academic  Center.  In  addition, 
participants  are  provided  instruction  in  learning  skills  strategies.  At  the  end  of  the 
academic  year,  participants  in  the  Plebe  Intervention  Program  are  enrolled  in  the 
Academic  Counseling  Program  in  either  the  Category  I  program  or  the  Category  II 
program. 

Selection  for  participation  in  the  Plebe  Intervention  Program  is  the  result 
of  cooperative  analysis  between  the  Academic  Center  and  the  Admissions  Office.  Each 
summer,  prior  to  the  arrival  of  the  incoming  class  of  Midshipmen,  the  Admissions  Office 
identities  incoming  Midshipmen  who  may  or  may  not  be  potential  candidates  for 
participation  in  the  Plebe  Intervention  Program.  This  list  is  forwarded  to  the  Academic 
Center  for  further  analysis.  The  Academic  Center  analyzes  the  individual  records  of  each 
of  the  incoming  Midshipmen  and  generates  a  “watch-list.”  This  watch-list  typically 
consists  of  200  incoming  Midshipmen.  The  primary  variables  that  are  analyzed  to 
determine  placement  on  the  watch-list  are  Scholastic  Aptitude  Test  (SAT)  and  Whole 
Person  Multiple  (WPM).  The  SAT  criteria  for  placement  on  the  watch-list  are  scores 
below  500  on  the  verbal  portion  and  scores  below  600  on  the  math  portion.  Incoming 
Midshipmen  with  WPM  less  than  60,000  are  typically  assigned  to  the  watch-list. 
Although  the  initial  watch-list  is  based  largely  on  objective  variables,  recommendations 
are  also  received  from  the  Admissions  Board  and  the  Naval  Academy  Athletic 
Association  (NAAA)  for  individuals  who  may  need  additional  academic  support  and 
should  be  included  in  the  Plebe  Intervention  Program. 

During  Plebe  Summer,  upon  arrival  at  the  Naval  Academy,  the  students 
are  subjected  to  validation  and  placement  exams  for  the  institution’s  core  courses.  These 
tests  measure  three  main  abilities  and  serve  as  the  indicator  for  assignment  to  the  various 
levels  of  courses  during  academic  year:  mathematical,  English,  and  science  (chemistry 

and  physics).  Students  who  score  poorly  on  these  exams  may  be  added  to  the  watch-list. 
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Following  the  examinations  during  Plebe  Summer,  the  list  is  finalized  and 
further  analyzed  to  determine  the  final  composition  of  the  PIP.  Only  those  who  are 
deemed  most  susceptible  to  academic  difficulty  are  selected  for  inclusion  in  the  program. 
Of  the  approximately  200  individuals  who  comprise  the  watch-list,  60  or  so  are  selected 
to  participate  in  the  Plebe  Intervention  Program. 

Inclusion  in  the  PIP  is  based  solely  on  quantitative  data  analysis. 
Currently,  there  is  no  qualitative  analysis  being  conducted  on  in-coming  Midshipmen  to 
determine  academic  motivation.  In  the  past,  the  Academic  Center  utilized  the  LAS  SI  to 
identify  Midshipmen  who  might  be  more  inclined  to  experience  academic  difficulty.  In 
2001,  however,  the  Naval  Academy  discontinued  administering  this  inventory. 

f  Tutoring  Programs 

The  Academic  Center  offers  three  different  tutorial  programs  to  the 
Brigade  of  Midshipmen:  the  Midshipmen  Study  Group  Program  (MGSP),  Hourly 
Tutoring,  and  X-Class  Tutoring.  Participation  in  any  of  these  programs  is  not  mandatory 
and  all  tutorial  services  are  available  for  the  entire  Brigade. 

g.  MGSP 

The  purpose  of  the  MGSP  is  to  “help  all  students  in  historically  difficult 
classes  master  the  course  content,  while  at  the  same  time  helping  them  to  develop 
personal  learning  techniques  and  study  strategies.”  (Academic  Center,  2003).  Modeled 
after  the  Supplemental  Instruction  Program  developed  at  the  University  of  Missouri 
Kansas  City  in  1973,  the  MGSP  has  experienced  significant  growth  in  the  past  five  years. 
Initiated  in  1997,  MGSP  was  only  offered  in  the  general  chemistry  courses.  Over  the 
course  of  the  next  seven  years,  however,  the  program  has  expanded  to  provide  academic 
support  in  pre-calculus  courses,  calculus  courses  (Calculus  I  and  II),  statics  course, 
dynamics  course,  and  physics  courses. 

MGSP  study  sessions  typically  consist  of  practicing  homework  problems 
and  test  preparation.  In  addition,  however,  many  MGSP  sessions  involve  reviewing 
concepts  covered  during  lectures,  discussing  laboratory  results  and  findings,  as  well  as 
discussions  of  assigned  readings  (Midshipmen  Group  Study  Program,  n.d.). 


26 


Similarly  to  the  program  initiated  at  the  University  of  Missouri  Kansas 
City,  the  primary  instructors  in  the  MGSP  are  students  who  have  demonstrated  academic 
excellence  in  the  area  in  which  they  provide  academic  support.  Candidates  for  study 
group  leaders  are  solicited  by  the  Academic  Center  and  are  carefully  selected  by  the 
program’s  coordinator.  Each  year,  approximately  70  Midshipmen  are  involved  in  the 
program.  While  some  may  serve  as  study  group  leaders,  others  may  serve  as  discipline 
leaders  and  are  responsible  for  coordinating  program  requirements  and  supervising  Study 
Group  Leaders.  Criteria  for  selection  as  a  Study  Group  Leader  are  as  follows: 

•  Cannot  be  a  Plebe.  Only  Pirst-class  through  Third  Class  Midshipmen  are 
eligible. 

•  Good  academic  standing  within  the  Brigade. 

•  Validated  the  course  during  Plebe  Summer  examinations  or  received  an 
“A”  or  “B”  in  the  course  in  which  they  will  be  the  study  group  leader. 

•  Receive  a  recommendation  from  a  faculty  member  within  the  department 
of  the  course  in  which  they  will  be  a  Study  Group  Leader. 

Upon  selection  as  a  Study  Group  Leader,  a  Midshipman  participates  in  a 
training  and  education  program  designed  to  provide  the  Study  Group  Leader  with  basic 
pedagogical  skills.  This  training  continues  throughout  the  academic  year  and  consists  of 
periodic  workshops  that  address  such  topics  as  methodology,  theory,  and  practice  of 
leading  small  group  study  sessions.  In  addition,  Study  Group  Leaders  are  required  to 
meet  with  faculty  representatives  to  determine  appropriate  and  suitable  instruction  topics 
for  each  of  the  study  group  sessions. 

The  MGSP  leaders  do  not  receive  financial  compensation  for  their 
participation  in  the  course.  Rather,  they  earn  academic  credits.  Those  Midshipmen  who 
serve  as  group  session  leaders  receive  one  credit.  Midshipmen  who  serve  as  supervisors 
receive  two  credits. 

h.  Hourly  Tutoring 

Hourly  tutoring  is  provided  by  the  Academic  Center  for  those  Midshipmen 
who  are  experiencing  severe  academic  difficulty.  In  addition,  they  have  utilized  other 
Academic  Center  services  and  have  not  responded  to  the  assistance. 
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At  the  Academic  Center,  there  are  eight  part-time  tutors  and  one  full-time 
tutor.  Tutors  are  available  for  specific  assistance  in  calculus,  chemistry,  physics, 
engineering,  and  Spanish. 

For  Midshipmen  to  be  eligible  for  hourly  tutoring,  they  must  complete  an 
on-line  application.  Upon  completion  of  the  survey,  the  Academic  Center  schedules  an 
appointment  with  the  Midshipman  and  conducts  an  historical  analysis  of  his/her 
academic  performance.  Not  every  student  who  applies  for  hourly  tutoring  is  approved 
(Academic  Center,  2003).  Again,  it  is  only  those  who  are  in  the  most  need  that  are 
approved  for  the  program. 

i.  X-Classes 

This  program  works  in  conjunction  with  the  PIP.  The  purpose  of  the 
program  is  to  provide  early  intervention  for  students  who  have  been  identified  as  likely  to 
experience  academic  difficulty. 

Currently,  X-Classes  are  only  offered  in  calculus.  These  courses,  which 
are  not  credit  earning,  are  paired  with  the  Midshipman’s  regular  course  of  study.  In 
addition,  very  few  Midshipmen  are  permitted  attendance.  For  example,  during  the  Fall 
semester  FY04,  only  six  Midshipmen  were  enrolled  in  the  X-Classes  (Academic  Center, 
2004).  During  an  X-Class,  Midshipmen  review  and  practice  problems  under  the 
supervision  of  a  professional  tutor. 

L.  CONCLUSION 

Although  it  is  not  their  primary  mission,  the  Academic  Center  provides  academic 
assistance  to  at-risk  students  to  reduce  attrition.  This  is  done  through  a  variety  of 
programs  that  are  grounded  in  theoretical  research.  Although  each  program  has  been 
successful,  there  has  yet  to  be  a  single  study  examining  whether  or  not  one  approach  is 
more  successful  than  the  others. 
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III.  RESEARCH  METHODOLOGY 


A.  INTRODUCTION 

The  purpose  of  this  study  is  to  analyze  the  impact  of  academic  assistance 
programs  at  the  United  States  Naval  Academy  on  at-risk  student  retention  during  his  or 
her  freshman  year.  Because  a  student  is  most  vulnerable  to  attriting  during  his  or  her 
freshman  year,  only  the  freshman  year  is  analyzed.  Essentially,  this  study  measures 
whether  or  not  a  student’s  participation  in  academic  assistance  programs  will  lead  to 
higher  retention  rates  during  a  student’s  freshman  year.  In  addition  to  this  fundamental 
research  question,  the  following  questions  will  be  answered: 

•  What  are  the  qualitative  differences  between  students  selected  to  the  PIP 
as  opposed  to  those  selected  for  the  watch-list? 

•  Is  there  a  quantifiable  difference  in  performance  between  students  selected 
for  participation  in  PIP  as  opposed  to  those  selected  for  the  watch-list? 

The  Naval  Academy’s  Office  of  Institutional  Research,  Planning  and  Assessment 
and  the  Academic  Center  provided  performance  and  demographic  data  used  in  this  study. 
Information  from  these  sources  was  merged  to  provide  performance  and  demographic 
information  on  the  individuals  included  in  the  study.  In  addition,  a  survey  measuring 
academic  motivation  was  administered  to  selected  Midshipmen  currently  attending  the 
Naval  Academy.  The  study  examines  the  performance  differences  among  remedial 
students  admitted  to  the  Naval  Academy  from  the  classes  of  2005  through  2007. 

B.  DATA  SOURCES 

1.  Office  of  Institutional  Research,  Planning  and  Assessment 

The  Naval  Academy’s  Office  of  Institutional  Research,  Planning  and  Assessment 
provided  the  demographic  and  perfonnance  information  for  each  officer  included  in  this 
study.  Established  in  1992,  this  office  is  responsible  for  evaluating  institutional  data  and 
assisting  in  the  development  of  admissions  and  educational  processes  at  the  Naval 
Academy.  IR  is  also  responsible  for  administering  all  surveys  to  Midshipmen,  faculty, 
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and  staff  at  the  Naval  Academy  (USNA  IR  Homepage,  2005).  To  accomplish  its  mission 
and  goals,  IR  maintains  a  data  warehouse  that  contains  information  on  every 
Midshipman.  Inputs  into  the  data  warehouse  begin  during  the  admissions  process  and 
throughout  his  or  her  matriculation. 

As  part  of  this  study,  IR  provided  information  on  those  students  who  participated 
in  the  PIP  as  well  as  those  students  identified  as  part  of  the  watch-list  from  the  classes  of 
2005  through  2007.  The  dataset  consisted  of  909  cases.  Of  the  909  cases,  166  were 
participants  in  the  PIP.  Of  the  166  selected,  130  persisted  until  at  least  their  sophomore 
year.  The  remaining  cases  analyzed  (743)  were  those  selected  to  be  on  the  watch-list. 

2.  Academic  Center 

Another  source  of  infonnation  relevant  to  this  study  is  maintained  by  the 
Academic  Center.  The  Academic  Center  provides  oversight  of  all  academic  assistance 
programs  at  the  Naval  Academy.  The  Academic  Center  provided  information  on  the 
students  selected  for  inclusion  in  the  PIP  and  the  watch-list  from  AY  2002-2005.  This 
data  set  consisted  of  166  participants  in  PIP  and  743  selectees  for  the  watch-list.  The 
total  number  of  cases  was  909. 

3.  Data  Merge 

Data  from  IR  and  the  Academic  Center  were  merged  utilizing  a  Midshipman’s 
alpha  code.  The  dataset  consists  of  those  Midshipmen  who  were  assigned  to  the  PIP  as 
well  as  the  watch-list.  The  dataset  consists  of  909  cases. 

C.  DEPENDANT  VARIABLES 

1.  Plebe  Intervention  Program  (PIP)  and  Watch-list  Students 

At  the  United  States  Naval  Academy,  students  determined  to  be  most  at-risk  are 
assigned  to  the  PIP.  Thus,  students  selected  for  this  program  are  detennined  to  be  most 
susceptible  to  attrition  during  their  freshman  year.  Another  group  that  is  detennined  to 
be  at-risk  is  those  placed  on  the  watch-list.  Though  not  as  susceptible  as  those  in  the  PIP, 
these  students  have  been  identified  by  the  Naval  Academy  to  possess  certain  qualities 
that  may  require  additional  assistance  if  they  fail  to  successfully  meet  the  academic 
requirements  of  their  course  of  study.  These  students  are  monitored  throughout  their 
freshman  year  and  may  be  enrolled  in  additional  academic  assistance  programs  if  the 
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need  arises.  To  analyze  differences  between  the  two  groups,  a  logistic  regression  was 
utilized  using  PIP  as  the  dependant  variable.  The  model  incorporated  selected 
independent  variables  that  will  be  discussed  later  in  the  chapter.  Table  4  outlines  the 
frequencies  of  each  of  the  groups. 


Table  4.  Frequency  of  Selected  Cases  (AY2002-2005) 


PIP  (Percent) 

Watch-list  (Percent) 

Total  (Percent) 

N 

166(18.3%) 

743  (81.7%) 

909  (100%) 

2.  Attrition 

As  discussed  in  the  literature  review,  students  are  most  susceptible  to  attrite 
during  their  freshman  year.  There  are  a  number  of  reasons  for  which  a  student  may 
attrite.  At  the  Naval  Academy,  there  are  four  main  categories  used  to  classify  reasons 
why  a  student  attrites:  academic,  voluntarily,  involuntarily  (conduct/honor  related), 
and/or  medical.  For  the  purposes  of  this  study,  only  academic  and  voluntary  attrites  are 
analyzed.  Academic  attrites  are  analyzed  because  they  failed  to  meet  the  academic 
requirements  of  the  institution.  Voluntary  attrites  are  analyzed  because  they  choose  not 
to  persist.  As  discussed  in  the  literature  review,  oftentimes  students  disenroll  despite 
significant  academic  difficulties.  Some  examples  for  which  a  student  might  disenroll 
would  be  lack  of  motivation  or  personal  reasons. 


To  analyze  attrition  at  the  Naval  Academy  during  a  student’s  freshman  year,  a 
binomial  regression  model  is  utilized  with  ‘reason  for  leaving’  as  the  dependant  variable. 
There  were  three  categories  analyzed:  retention,  attrition  due  to  academic  difficulties, 
and  attrition  due  to  voluntary  reasons.  Table  5  represents  the  reasons  for  which  students 
attrited  during  their  freshman  year  at  the  Naval  Academy. 


Table  5.  Reason  for  Leaving  (AY2002-2005) 


Percent 

Voluntary 

93 

10.2% 

Involuntary 

10 

11.3% 

Academic 

63 

18.2% 

Medical 

9 

19.2% 

Remain 

734 

100% 

Total 

909 

31 


3.  Academic  Performance 

Per  the  literature  review,  academic  performance  is  closely  correlated  to 
persistence.  When  students  perform  well  in  the  classroom,  it  is  more  likely  that  they  will 
persist  in  their  education.  Conversely,  students  who  do  poorly  in  the  classroom  are  more 
inclined  to  fail  to  persist.  At  the  United  States  Naval  Academy,  the  Administration  has 
implemented  a  number  of  academic  assistance  programs  to  improve  performance  and, 
thus,  encourage  persistence.  Two  programs  that  are  discussed  in  the  literature  review  are 
the  PIP  and  the  MGSP.  Each  of  these  programs  is  designed  to  improve  the  academic 
performance  of  the  participants.  The  third  model  to  be  analyzed  measures  the  academic 
performance  of  students  with  similar  characteristics  (PIP  and  Watch-list)  based  on  their 
participation  or  non-participation  in  academic  assistance  programs.  To  measure  the 
effectiveness  of  the  assistance,  the  dependant  variable  to  be  analyzed  is  the  change  in 
grade  from  the  six-week  mark  in  a  particular  course  and  the  final  grade  that  was  awarded 
to  the  student  (AVGDIF).  Only  core  courses  are  analyzed.  These  core  courses,  which 
are  required  by  all  freshmen  at  the  Naval  Academy,  include:  Calculus  I,  Calculus  II, 
Chemistry  I,  and  Chemistry  II.  Of  the  909  cases  in  the  study,  grades  in  these  courses  are 
available  for  586  students.  An  Ordinary  Least  Squares  (OLS)  model  is  used  to  analyze 
the  dependant  variable.  Specific  independent  variables  to  be  included  in  the  model  will 
be  discussed  later  in  the  chapter.  Table  6  describes  the  dependant  variable  (difference  in 
six- week  grade  and  final  grade). 


Table  6.  Difference  in  Six-Week  Grade  and  Final  Grade  (AY2002-2005) 


N 

Minimum 

Maximum 

Mean 

Standard 

Deviation 

Average 

Difference 

586 

-2 

2 

-0.07 

0.48 

Total 

586 

D.  INEPENDANT  VARIABLES 

1,  Plebe  Intervention  Program  (PIP) 

As  discussed  in  the  literature  review,  students  admitted  to  the  Naval  Academy 
determined  to  be  the  most  at-risk  are  enrolled  in  the  PIP.  Based  on  their  entrance  data, 
these  students  are  more  likely  to  attrite  than  those  not  enrolled  in  the  program.  It  is  for 
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this  reason  that  they  are  afforded  additional  assistance.  This  variable  (PIP)  is  related  to 
two  dependant  variables:  attrition  and  performance.  During  AY  2002-2005,  166 
students  were  enrolled  in  the  PIP.  Of  the  166,  36  (or  22%)  did  not  persist  to  their 
sophomore  year  of  studies.  Thus,  130  (or  78%)  students  completed  their  freshman  year. 
Table  7  provides  data  on  those  students  enrolled  in  the  PIP  during  AY  2002-2005  and 
their  status  at  the  end  of  their  freshman  year. 

Table  7.  PIP  Participants  Academic  Status  at  the  End  of  Plebe  Year  (AY  2002- 


2005) 


Frequency 

Percent 

Reason  For  Leaving 

Voluntary 

15 

9.04% 

Academic 

19 

11.45% 

Medical 

2 

1.2% 

Persisted  to  Sophomore 
Year 

130 

78.31% 

Total 

166 

100 

2.  SAT  Math  average  scores  (SATMAVG) 

At  the  United  States  Naval  Academy,  there  is  a  heavy  emphasis  on  technical 
courses.  These  courses  often  have  a  foundation  in  mathematics.  Scores  on  the  math 
portion  of  the  SAT  are  believed  to  be  closely  correlated  to  a  student’s  perfonnance  in 
many  courses  offered  at  the  Naval  Academy.  For  the  purpose  of  this  study,  the  courses 
being  analyzed  are  Chemistry  and  Calculus.  Thus,  a  students’  perfonnance  on  the  math 
portion  of  the  SAT  will  be  included.  Table  8  details  the  differences  in  scores  between 
PIP  selected  students,  watch-list  selected  students,  and  total  population.  PIP  students,  on 
average,  scored  32  points  lower  on  the  math  portion  of  the  SAT  than  watch-list  students. 
In  addition,  an  independent  samples  means  test  was  conducted  and  the  t-value  was  -7.84. 
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Table  8.  Differences  in  Scores  Between  PIP-Selected  Students  and  Watch-List 


Selected  Students  on  SAT  Math  (AY  20' 

02-2005) 

PIP 

Selected 

Students 

Watch-List 
Selected  Students 

Total  Population 

Valid  N 

166 

743 

909 

SAT 

Math 

Average 

544 

576 

570 

Minimum 

420 

425 

420 

Maximum 

660 

760 

760 

Standard 

Deviation 

45.4 

55.4 

55.1 

3.  SAT  Verbal  Average  Scores  (SAMVAVG) 

As  part  of  the  admissions  process,  SAT  Verbal  scores  are  closely  scrutinized. 
Perfonnance  on  the  verbal  portion  of  the  SAT  is  closely  related  to  each  of  the  dependant 
variables.  Table  9  details  the  average  scores  on  the  verbal  portion  of  the  SAT  for  the 
PIP-selected  students,  watch-list  selected  students,  and  the  total  population.  On  average, 
PIP  students  scored  13  points  lower  on  the  verbal  portion  of  the  SAT  than  watch-list 
students.  An  independent  samples  means  test  was  conducted  and  the  t-value  was  -2.46. 


Table  9.  Differences  in  Scores  Between  PIP-Selected  Students  and  Watch-List 


Selected  Students  on  SAT  Verbal  (AY  201 

02-2005) 

PIP 

Selected 

Students 

Watch-List 
Selected  Students 

Total  Population 

N 

166 

743 

909 

SAT  Verbal  Average 

542 

555 

553 

Minimum 

364 

330 

330 

Maximum 

686 

790 

790 

Standard  Deviation 

61.53 

55.35 

65.4 

4.  Gender  (GENDER2) 

Gender  is  an  independent  variable  that  is  related  to  all  dependant  variables 
selected.  Table  10  details  the  gender  composition  of  the  PIP,  the  watch-list,  and  the  total 
population.  Gender  representation  is  consistent  in  each  group  as  there  is  only  a  2.5% 
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difference  in  female  representation  in  each  of  the  groups.  An  independent  samples  means 
test  was  conducted  and  produced  a  t-value  of  3. 15. 

Table  10.  Gender  Composition  of  PIP  and  Watch-list  (AY  2002-2005) 


PIP  (Percent) 

Watch-list 

(Percent) 

Total  Population 
(Percent) 

Male 

135  (81.3%) 

623  (83.8%) 

758  (83.4%) 

Female 

31  (18.7%) 

120(16.2%) 

151  (16.6%) 

Total 

166 

743 

909 

5.  Ethnicity 

Ethnicity  is  an  independent  variable  related  to  all  dependant  variables.  Ethnicity 
is  divided  into  four  subpopulations:  Caucasian  (CAUCASIAN),  African  American 
(AFRICANAMERICAN),  Hispanic  (HISPANIC),  and  Other  Ethnicities 
(OTHERETHNIC).  Table  11  details  the  ethnic  composition  of  the  PIP,  the  watch-list, 
and  the  total  population.  Table  12  outlines  the  chi-square  value  for  each  variable. 
Although  Caucasian  representation  in  the  PIP  is  consistent  with  watch-list  assignment, 
African  American  representation  on  the  PIP  exceeds  the  watch-list  (+5.2%).  In  addition, 
Hispanics  are  more  represented  in  PIP  than  the  watch-list  (+4.1%). 


Table  11.  Ethnicity  Composition  of  PIP  and  Watch-list  (AY  2002-2005) 


PIP  (Percent) 

Watch-list 

(Percent) 

Total  Population 
(Percent) 

Caucasian 

109  (65.7%) 

481  (64.7%) 

590  (64.9%) 

African  American 

33  (19.9%) 

109  (14.7%) 

142(15.5%) 

Hispanic 

19(11.4%) 

115  (15.5%) 

134(14.7%) 

Other  Ethnicities 

5  (3%) 

38  (5.1%) 

43  (4.7%) 

Total 

166 

743 

909 

Table  12.  Chi-Square  Values  for  Ethnicity  Variables  (AY2002-2005) 


Ethnicity 

Chi-Square  Value 

df 

Significance 

Caucasian 

.051 

1 

.821 

African  American 

2.79 

1 

.095 

Hispanic 

1.76 

1 

.185 

Other  Ethnicities 

1.33 

1 

.249 
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6.  Whole  Person  Multiple  (CM1000) 

Applicants  to  the  Naval  Academy  are  awarded  an  objective  score  based  on 
calculations  of  specific  admissions  criteria  such  as  highest  SAT  or  converted  ACT  scores 
in  math  and  verbal,  official  rank  in  class,  participation  in  extracurricular  activities,  and 
recommendations  of  school  officials.  This  is  done  to  evenly  evaluate  candidates’ 
qualifications.  Because  a  students’  whole  person  multiple  (WPM)  is  based  on  past  high 
school  perfonnance,  it  can  be  used  as  a  predictor  of  future  perfonnance.  Table  13 
contains  the  average  WPM  of  students  selected  for  the  PIP  and  the  Watch-list.  (Note: 
scores  depicted  in  the  table  represent  a  student’s  WPM  divided  by  one  thousand.)  In 
addition,  an  independent  samples  means  test  was  conducted  and  produced  a  t-value  of  - 
5.46. 

Table  13.  Differences  in  WPM  (xlOOO)  of  PIP  and  Watch-list  Selected  Students 


(AY  2i 

002-2005) 

PIP 

Watch-list 

Total 

Population 

Mean  WPM 

57.38 

59.54 

59.15 

Minimum 

47.23 

46.2 

46.21 

Maximum 

67.4 

73.07 

73.07 

Standard 

Deviation 

3.92 

4.76 

4.69 

N 

166 

743 

909 

7.  Recommendations  of  the  Admissions  Board  Scores  (RAB500) 

The  Admissions  Board  at  the  Naval  Academy  is  authorized  by  the  Superintendent 
to  award  Recommendations  of  the  Admissions  Board  to  individual  candidates  if  the 
candidate’s  candidate  multiple  does  not  accurately  reflect  his  potential  and  motivation  to 
succeed  in  a  career  in  the  Naval  Service.  As  evidenced  in  his  or  her  complete  application 
(such  as  high  achievement  in  extra  curricular  activities  participation  or  other  factors  that 
are  not  measurable)  the  Admissions  Board  may  award  a  candidate  additional  points 
toward  his  or  her  candidate  multiple.  These  points,  known  as  RABs,  are  awarded  in  500 
point  increments.  This  variable  is  important  to  include  because  it  indicates  that  a  student 
possesses  intangible  qualities  that  give  the  Board  reason  to  believe  he  or  she  will  succeed 
at  the  Naval  Academy.  Table  14  details  the  average  RABs  awarded  to  PIP  selected 
students,  watch-list  selected  students,  and  the  total  population.  On  average,  PIP  students 
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receive  more  RABs  than  watch-list  students.  This  may  be  due  to  the  fact  that  PIP 
students,  because  of  their  high  school  records,  are  more  in  need  of  such  assistance. 


Table  14.  Differences  in  Recommendations  of  the  Admissions  Board  (x500) 
between  PIP  and  Watch-list  selected  students  (AY  2002-2005) 


PIP 

Watch- 

list 

Total 

Population 

RABs 

Awarded 

7.51 

5.8 

6.1 

Minimum 

-1 

-2 

-2 

Maximum 

26 

27.6 

27.6 

Standard 

Deviation 

5.56 

5.15 

6.11 

Total 

166 

743 

909 

8.  Recruited  Athlete  (BLUE) 

At  the  Naval  Academy,  certain  recruited  athletes  are  granted  waivers  to  allow 
them  to  be  admitted.  These  “blue  chip”  athletes  are  allowed  to  attend  the  school  despite 
having  candidate  multiple  scores  below  60,000.  Table  15  contains  data  on  the 
composition  of  recruited  athletes  (blue  chip)  in  PIP,  the  Watch-list,  and  the  total 
population.  PIP  students  are  much  more  likely  to  be  recruited  athletes  than  watch-list 
students  (54%  to  30%).  An  independent  samples  means  test  was  conducted  and  produced 
a  t-value  of  5.82. 

Table  15.  Percentage  of  Recruited  Athletes  in  PIP  and  Watch-list  (AY  2002- 


2005) 


PIP  (Percent) 

Watch-list 

(Percent) 

Total 

Population 

(Percent) 

Recruited  Athlete  (Blue 
Chip) 

89  (53.61%) 

225  (30.28%) 

314  (34.54%) 

9.  Average  Six- Week  Grade  (AVG6WK) 

In  selected  courses,  scores  were  retrieved  at  the  six-week  period.  These  courses 
were  Chemistry  I,  Chemistry  II,  Calculus  I,  and  Calculus  II.  These  courses  were 
analyzed  because  all  freshman  must  complete  these  courses  during  their  freshman  year. 
Grades  in  these  courses  were  only  available  for  586  cases.  Of  the  166  cases  in  the  PIP, 
grades  were  known  for  112  students.  Of  the  743  cases  in  the  Watch-list,  grades  were 


37 


known  for  474.  Table  16  outlines  the  differences  in  six-week  grades  between  PIP,  the 
watch-list  selected  students,  and  the  total  population.  On  average,  PIP  students  were 
outperformed  by  watch-list  students  (-.72).  An  independent  samples  means  test  produced 
a  t-value  of  -9.29. 

Table  16.  Mean  Six-Week  Grades  of  PIP  and  Watch-list  Students  (AY  2002- 


2005) 


PIP 

Watch-list 

Total 

Population 

Mean 

1.53 

2.25 

2.11 

Minimum 

0 

0 

0 

Maximum 

3.33 

4 

4 

Standard  Deviation 

0.73 

0.73 

0.78 

N 

112 

474 

586 

10.  Participation  in  MGSP  (MSGONE  and  MSGTWOMO) 

As  noted  in  the  literature  review,  MGSP  is  a  form  of  SI  designed  to  prevent 
attrition.  In  addition,  it  was  also  noted  in  the  literature  review  that  degree  of  participation 
is  often  debated.  As  a  result,  two  independent  variables  were  created  to  address  this 
conflict.  The  first  independent  variable  (MSGONE)  created  was  to  determine  if  a  student 
participated  in  zero  or  one  MGSP  session.  It  was  detennined  that  participation  in  one 
MGSP  session  during  an  entire  year  may  not  constitute  active  participation.  The  second 
variable  created  (MSGTWOMO)  determined  if  a  student  participated  in  two  or  more 
MGSP  sessions  during  his  or  her  freshman  year.  Because  SI  is  aimed  at  improving 
retention,  these  variables  are  relevant  to  the  study.  Table  17  contains  data  on  the 
differences  between  PIP,  the  watch-list,  and  the  total  participation.  In  addition,  Table  17 
contains  the  t-value  as  a  result  of  an  independent  samples  means  test.  In  all  cases,  PIP 


students  participated  in  MGSP  more  than  watch-list  students. 

Table  17.  Participation  in  MGSP  by  PIP  and  Watch-list  Students  (AY  2002- 
_ 2005) _ 


Frequency 

PIP  (Percent) 

Watch-list 

(Percent) 

Total  Population 
(Percent) 

T-value 

Never  Attended 

95  (57.2%) 

493  (66.4%) 

588  (64.7%) 

2.16 

Attended  One 

Session 

34  (20.5%) 

109  (14.7%) 

143  (15.7%) 

-1.17 

Attended  More 

than  One  Session 

37  (22.3%) 

141  (19.0% 

178(19.6%) 

-.97 
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11.  Varsity  Athlete  during  Freshman  Year  (VARPLEBE) 

At  the  United  States  Naval  Academy,  a  student  faces  many  demands  that  are  not 
typical  for  students  at  other  institutions.  In  addition  to  academic  demands,  students  are 
also  faced  with  military  requirements  such  as  inspections,  quizzes,  and  professional 
lectures.  Although  military  demands  are  considerable,  freshman  who  participate  in 
varsity  athletics  face  even  more  demands.  While  these  student-athletes  still  complete  all 
academic  and  military  obligations,  they  must  also  meet  the  requirements  of  the  sport  in 
which  they  participate.  Oftentimes,  these  student-athletes  sacrifice  up  to  three  hours  per 
day.  For  this  reason,  this  variable  (VARPLEBE)  is  closely  related  to  two  dependant 
variables:  attrition  and  perfonnance.  Table  18  contains  data  on  PIP  participants,  watch- 
list  assignees,  and  the  total  population  that  participated  in  varsity  athletics  during  their 
freshman  year.  An  independent  samples  means  test  was  conducted  and  produced  a  t- 
value  of  -4.35.  As  depicted  in  the  table,  PIP  students  are  more  represented  on  athletic 
teams  during  their  plebe  year  than  watch-list  students. 

Table  18.  Varsity  Athletics  Participation  during  Plebe  Year  (AY2002-2005) 


PIP  (Percent) 

Watch-list 

(Percent) 

Total 

Population 

(Percent) 

Non  Varsity 
Athlete 

83  (50%) 

503  (67.7%) 

586  (64.5%) 

Varsity 

Athlete 

83  (50%) 

240  (32.3%) 

323  (35.5%) 

Total 

166  (100%) 

743  (100%) 

909  (100%) 

E.  RELATIONSHIP  OF  INDEPENDENT  VARIABLES  TO  DEPENDANT 

VARIABLES 

1.  PIP  Model 

To  measure  the  differences  between  the  two  groups,  the  dependant  variable  is 
specified  as  a  dichotomous  dependant  variable  (1=PIP,  0=watch-list).  A  non-linear 
binomial  logistic  regression  is  used  to  predict  assignment  to  PIP.  Table  19  identifies  the 
independent  variables  utilized  in  the  model  and  their  predicted  impact  on  assignment  to 
the  PIP. 
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Table  19.  Independent  Variables  Utilized  to  Predict  Assignment  to  the  PIP  (AY 
_  2002-2005) _ _ 


Variable 

Variable  Name 

Predicted 

Effect 

SAT  Math  Scores 

SATMAVG 

- 

SAT  Verbal  Scores 

SAMVAVG 

- 

Female 

GENDER2 

? 

Ethnicity 

African 

American 

AFRICANAMERICAN 

+ 

Hispanic 

HISPANIC 

+ 

Other 

Ethnicities 

OTHERETHNICITIES 

+ 

Recommendations  of 

the  Admissions  Board 

(RAB) 

RAB500 

+ 

Whole  Person 

Multiple  (WPM) 

CM  1000 

Recruited  Athlete 

(Blue  chip  athlete) 

BLUE 

Of  the  variables  included  in  the  model,  it  is  hypothesized  that  some  are  more 
likely  to  predict  assignment  to  the  PIP.  SAT  scores,  both  math  and  verbal,  are  likely  to 
determine  if  a  student  is  assigned  to  the  program.  In  particular,  SAT  math  scores  are 
believed  to  be  extremely  important  at  predicting  academic  success  at  the  Naval  Academy. 
Additionally,  due  to  the  nature  of  the  technical  aspect  of  core  courses  at  the  Naval 
Academy,  perfonnance  on  SAT  math  is  viewed  as  a  predictor.  As  a  result,  lower 
performance  on  the  SAT  math  will  cause  a  student  to  be  assigned  to  the  PIP.  Students 
with  low  whole  person  multiples  are  also  likely  to  be  assigned  to  the  PIP.  Another  group 
that  is  more  likely  to  be  assigned  to  PIP  is  recruited  athletes.  Because  recruited  athletes 
comprise  50%  of  the  PIP,  it  is  hypothesized  that  they  are  more  likely  to  be  assigned  to  the 
program.  Conversely,  ethnicity  is  not  believed  to  be  a  good  predictor  for  inclusion  in  the 
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PIP.  Based  on  the  descriptive  statistics  previously  discussed,  it  does  not  appear  likely 
that  ethnic  differences  will  cause  a  student  to  be  more  likely  assigned  to  the  program. 
Students  with  high  RABs  are  not  believed  to  be  more  likely  to  be  assigned  to  the  program 
because  they  have  demonstrated  a  certain  quality  to  the  Admissions  Board  that  makes 
them  less  likely  to  require  additional  assistance.  Finally,  gender  is  variable  that  is 
difficult  to  predict.  Because  females  comprise  equitable  percentages  within  the  PIP  and 
the  watch-list,  it  is  difficult  to  predict  if  they  are  more  likely  to  be  assigned  to  the 
program. 

2.  Attrition  Model 

To  measure  the  impact  of  independent  variables  on  a  students’  reason  for  attrition 
during  his  or  her  freshman  year,  a  Three-Way  Non-Linear  (Trinomial  Logistic)  model  is 
specified.  The  values  of  the  dependant  variables  are  voluntary  attrition,  academic 
attrition,  and  (the  reference  category)  remained  until  sophomore  year.  Table  20  identifies 
the  independent  variables  utilized  in  the  model  to  predict  attrition  for  academic  reasons 
and  voluntary  reasons  and  their  hypothesized  effects. 
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Table  20.  Predicted  Effect  of  Independent  Variables  Utilized  to  Measure 

Attrition  (AY2002-2005) 


Variable 

Variable  Name 

Attrite: 

Academic 

Attrite: 

Voluntarily 

Difference  in  final  course  grade  from  six- 

week  to  final  grade  in  core  courses 

AVGDIF 

Average  six-week  grade  in  core  courses 

AVG6WK 

+ 

+ 

SAT  Math  Scores 

SATMAVG 

+ 

+ 

SAT  Verbal  Scores 

SAMVAVG 

+ 

+ 

Attended  One  or  Less  MGSP  Sessions 

MSGONE 

? 

? 

Attended  Two  or  More  MGSP  Sessions 

MSGTWOMO 

+ 

+ 

Participated  in  Varsity  Athletics  During 

Freshman  Year 

VARPLEBE 

+ 

Female 

GENDER2 

? 

- 

Ethnicity 

African  American 

AFRICANAMERICAN 

? 

? 

Hispanic 

HISPANIC 

? 

? 

Other  Ethnicities 

OTHERETHNIC 

? 

? 

Participant  in  PIP 

PIP 

- 

- 

a.  Academic  Attrition 

Of  the  variables  selected,  academic  performance  and  academic  assistance 
programs  will  have  the  greatest  impact  on  whether  one  will  attrite  for  academic  reasons. 
If  students  have  poor  academic  perfonnance  (difference  between  six-week  and  final 
grade),  then  he  or  she  is  more  likely  to  attrite  for  academic  reasons.  In  addition,  if 
students  seek  additional  academic  assistance,  it  is  hypothesized  that  they  are  less  likely  to 
attrite  for  academic  reasons.  Students  who  only  attend  one  MGSP  session,  however,  are 
not  deemed  as  an  active  participant  and,  as  a  result,  it  is  unclear  if  the  program  will  have 
an  effect  on  these  students.  Factors  such  as  gender  and  ethnicity  are  not  believed  to 
effect  persistence  to  any  significant  degree.  Finally,  if  a  student  is  enrolled  in  PIP,  it  is 
believed  that  he  or  she  is  more  likely  to  attrite  for  academic  reasons  for  the  simple  fact 
that  they  represent  those  students  who  were  admitted  with  the  lowest  qualifications. 
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b.  Voluntary  Attrition 

The  hypothesized  effect  of  independent  variables  on  whether  or  not  a 
student  persists  to  his  or  her  sophomore  year  are  largely  based  on  social  factors.  It  is 
believed  that  those  students  who  are  actively  involved  in  group  activities  are  more  likely 
to  persist.  For  example,  students  who  play  sports  and/or  involve  themselves  in  MGSP  are 
more  likely  to  develop  a  support  network  that  will  aid  them  in  their  adjustment  to  college. 
Conversely,  it  is  hypothesized  that  females  are  more  likely  to  attrite  for  voluntary  reasons 
because  they  may  not  be  able  to  establish  strong  support  networks  due  to  the 
overrepresentation  of  males  at  the  Naval  Academy.  Academically,  it  is  hypothesized  that 
those  who  struggle  will  be  more  likely  to  attrite  for  voluntary  reasons.  For  this  reason, 
variables  of  an  academic  nature  (grades  and  SAT  scores)  are  more  likely  to  predict 
attrition  for  voluntary  reasons.  Included  in  this  category  are  PIP  participants.  Because  it 
is  believed  that  they  are  more  likely  to  struggle  academically,  it  is  believed  that  they  are 
more  likely  to  leave  for  voluntary  reasons.  Finally,  the  impact  of  ethnicity  is 
undeterminable. 

3.  Performance  Differences 

To  measure  the  impact  of  selected  independent  variables  on  performance  during  a 
student’s  freshman  year  at  the  United  States  Naval  Academy,  an  Ordinary  Least  Squares 
Model  is  utilized.  The  dependant  variable  was  the  average  difference  in  performance 
from  the  six-week  point  in  a  course  to  the  final  grade  that  was  awarded.  Table  21 
identifies  the  independent  variables  utilized  in  the  model  and  the  predicted  effect. 
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Table  21.  Independent  Variables  Utilized  to  Predict  Effect  on  Differences 
Between  Six-week  Grades  and  Final  Grade  Awarded  (AY2002-2005) 


Variable 

Variable  Name 

Effect:  Performance 

Average  six-week  grades 

AVG6WK 

+ 

SAT  Math  Scores 

SATMAVG 

+ 

SAT  Verbal  Scores 

SAMVAVG 

+ 

Participated  in  one  or  less  MGSP 

sessions 

MSGONE 

? 

Participated  in  two  or  more 

MGSP  sessions 

MSGTWOMO 

+ 

Participated  in  Varsity  Athletics 

VARPLEBE 

- 

Female 

GENDER2 

? 

Ethnicity 

African 

American 

AFRICANAMERICAN 

? 

Hispanic 

HISPANIC 

? 

Other  Ethnicities 

OTHERETHNIC 

? 

Participant  in  PIP 

PIP 

- 

In  this  model,  it  is  hypothesized  that  those  students  with  the  higher  academic 
entry  scores  (SAT)  are  more  likely  to  perform  better  throughout  a  given  course. 
Similarly,  those  who  seek  additional  academic  assistance  are  more  likely  to  improve  in 
their  perfonnance.  It  is  uncertain,  however,  if  participation  in  only  one  MGSP  session 
will  produce  any  improvement  in  a  given  course.  It  is  also  believed  that  students 
participating  in  athletics  will  experience  greater  academic  difficulties  than  non-athletes 
due  to  the  commitment  that  these  students  make  to  the  sport  in  which  they  participate. 
Finally,  it  is  unclear  whether  or  not  a  student’s  ethnicity  or  gender  will  impact  his  or  her 
academic  performance. 

F.  QUAFITATIVE  DATA 

An  exploratory  survey  was  administered  to  PIP  participants  from  AY  2002-2005. 


The  purpose  of  the  survey  was  to  measure  motivation  and  attempt  to  identify 
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characteristics  of  at-risk  students  who  leads  to  persistence.  The  survey  was  administered 
to  all  130  students  at  the  Naval  Academy  who  participated  in  the  PIP.  The  survey  was 
not  administered  to  the  36  students  who  failed  to  persist  at  the  Naval  Academy  beyond 
their  freshman  year.  Of  the  130  students  surveyed,  100  students  responded  (76.92%). 
Results  of  the  survey  are  contained  in  Appendix  A. 

There  were  23  questions  on  the  survey.  Of  the  23  questions,  13  were  scored  using 
a  Likert  Scale.  The  remaining  10  questions  required  students  to  select  an  answer  that  best 
described  their  attitude.  If  a  selection  was  not  available  that  reflected  their  attitude,  they 
provided  additional  text. 

Closely  modeled  after  the  College  Student  Inventory  (CSI),  the  survey  measures  a 
student’s  motivation  in  the  following  areas:  academics,  coping  skills,  social  influences, 
and  receptivity  to  support  services.  In  addition  to  measuring  a  student’s  motivation  in 
each  of  these  areas,  additional  questions  were  posed  to  evaluate  the  current  academic 
assistance  programs  available  to  at-risk  students  at  the  Naval  Academy.  Table  22 
outlines  the  number  of  questions  that  were  asked  in  a  particular  category. 

Table  22.  Motivation  Survey:  Number  of  Questions  per  Category 


Category 

Number  of  Questions 

Academic  Motivation 

3 

Coping  Skills 

5 

Social  Motivation 

6 

Receptivity  to  Support  Services 

4 

Evaluation  of  Current  Academic 

Assistance  Programs 

5 
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IV.  DATA  ANALYSIS 


The  results  of  three  models  are  discussed  in  this  chapter.  The  first  model  analyzes 
the  differences  between  students  selected  for  inclusion  in  the  PIP  and  those  who  were 
assigned  to  the  watch-list.  The  second  model  analyzes  the  impact  of  selected 
independent  variables  on  at-risk  student  attrition  at  the  Naval  Academy.  Finally,  the  third 
model  analyzes  the  impact  of  selected  independent  variables  on  student  performance  in 
core  courses.  In  all  models,  SPSS  11.0  is  utilized.  The  results  of  the  models  are 
contained  in  Appendix  B. 

In  addition,  results  of  survey  data  are  discussed.  Where  appropriate,  survey  data 
is  used  to  elucidate  the  findings  in  the  quantitative  analysis.  Case  processing  summaries 
for  each  model  are  provided  in  tables  throughout  the  chapter.  Results  from  each  of  the 
models  are  discussed  in  their  respective  sections. 

A.  PIP  PREDICTION  MODEL  (PIP  AS  DEPENDANT  VARIABLE) 

In  this  model  (logistic  regression),  the  dependant  variable  is  whether  or  not  a 
student  is  selected  to  participate  in  PIP.  Control  variables  include  demographic 
information.  The  explanatory  variables  include:  SAT  math  averages,  SAT  verbal 
averages,  gender,  ethnicity,  whole  person  multiple,  recommendations  of  the  Admissions 
Board  (RAB),  and  whether  or  not  a  student  is  a  recruited  (blue  chip)  athlete.  Thus,  the 
model  is  specified  as  follows: 

PIP  =  /  (SAT  math  average,  SAT  verbal  average,  gender,  ethnicity,  whole 
person  multiple,  RAB,  and  recruited  athlete) 


The  -2  Log  likelihood  is  765.91.  The  model  had  a  Chi-square  value  of  84.58  with 
a  significance  level  of  .000.  Table  23  contains  the  coefficient  and  significance  levels  for 
each  of  the  independent  variables  (predictors).  Of  the  seven  independent  variables  used 
in  the  model,  four  were  significant  at  the  five  percent  or  better  level.  The  cut  value  for 
the  model  is  .184. 
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Table  23.  Logistic  Regression  Results  (PIP  as  Dependant  Variable) 


Variable 

Coefficient 

Significance 

SAT  Verbal 

.002 

.281 

SAT  Math 

-.012 

.000 

Gender 

-.009 

.971 

African  American 

-.020 

.938 

Hispanic 

-.149 

.616 

Other  Ethnicity 

-.328 

.526 

RAB500 

-.062 

.047 

Whole  Person 

Multiple 

-.100 

.021 

Recruited  Athlete 

.925 

.000 

1.  Discussion  of  Variables 
a.  SAT  Math 

A  student’s  SAT  math  scores  is  significant  at  the  one  percent  level.  This 
indicates  that  students  with  lower  SAT  math  scores  are  more  likely  to  be  assigned  to  the 
PIP.  Table  24  indicates  that  the  32-point  difference  in  SAT  math  scores  is  significant  and 
is  a  major  factor  used  to  select  at-risk  students  for  academic  assistance. 

Table  24.  Mean  SAT  Math  Averages  (AY2002-2005) 


PIP 

Watch-list 

Valid  N 

166 

743 

SAT  Math  Average 

544 

576 

b.  Recommendations  of  the  Admissions  Board 
Students  with  lower  RAB  scores  are  more  likely  to  be  assigned  to  the  PIP. 
As  discussed  in  an  earlier  chapter,  students  assigned  to  PIP  represent  those  students  with 
the  lowest  entry  characteristics.  Therefore,  it  is  logical  that  they  would  also  have  low 
RAB  scores. 
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c.  Whole  Person  Multiple 

Students  with  higher  whole  person  multiples  are  less  likely  to  be  assigned 
to  the  PIP.  Similarly  with  the  RAB  scores,  students  who  have  high  WPM  represent  the 
most  competitive  students  at  the  Naval  Academy  and  have  stellar  performance  records. 
Therefore,  it  is  logical  that  those  with  high  WPM  would  not  be  assigned  to  PIP.  This 
variable  is  significant  at  the  five  percent  level.  Table  13  describes  the  mean  whole  person 
multiple  of  each  of  the  groups. 

d.  Recruited  Athletes 

Recruited  athletes  are  more  likely  to  be  assigned  to  the  PIP  than  non- 
recruited  athletes.  This  variable  is  significant  at  the  one  percent  level.  As  reported 
earlier,  PIP  is  composed  of  far  more  recruited  athletes  than  the  watch-list  (50%  to  30%). 


In  conclusion,  the  results  of  the  model  indicate  four  major  differences  between 
those  students  assigned  to  the  PIP  as  opposed  to  those  assigned  to  the  watch-list.  The 
following  list  characterizes  students  assigned  to  the  PIP: 

•  They  have  significantly  lower  SAT  math  scores. 

•  They  have  lower  RAB  scores  than  those  assigned  to  the  watch-list. 

•  They  have  lower  WPM  than  those  assigned  to  the  watch-list. 

•  Students  assigned  PIP  are  much  more  likely  to  be  recruited  athletes. 

B.  ATTRITION  MODEL  (REASON  FOR  LEAVING  AS  DEPENDANT 

VARIABLE) 

In  this  model  (three-way  non-linear  regression),  the  dependant  variable  is  a 
student’s  reason  for  leaving  the  Naval  Academy.  The  dependant  variable  consists  of 
three  categories:  persist  to  sophomore  year,  attrites  for  academic  reasons,  and  attrites  for 
voluntary  reasons.  Control  variables  include  demographic  variables  as  well  as  other 
variables  that  are  believed  to  be  correlated  with  attrition.  The  control  variables  are: 
average  difference  between  six-week  grade  and  final  grade,  average  six-week  grades, 
SAT  math  averages,  SAT  verbal  averages,  whether  a  student  participated  in  one  or  less 
MGSP  session,  whether  or  not  a  student  participated  in  two  or  more  MGSP  sessions, 
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whether  or  not  a  student  is  an  athlete  during  his  or  her  plebe  year,  gender,  ethnicity,  and 
whether  or  not  a  student  is  assigned  to  the  PIP.  Thus,  the  model  is  specified  as  follows: 


Reason  for  Leaving  (Persisted  to  sophomore  year,  attrite  for  academic  reasons, 
or  attrite  for  voluntary  reasons)  =/ (average  difference  between  six-week 
grade  and  final  grade,  average  six- week  grades,  SAT  math  averages,  SAT 
verbal  averages,  whether  a  student  participated  in  one  or  less  MGSP 
session,  whether  or  not  a  student  participated  in  two  or  more  MGSP 
sessions,  whether  or  not  a  student  is  an  athlete  during  his  or  her  plebe 
year,  gender,  ethnicity,  and  whether  or  not  a  student  is  assigned  to  the 
PIP) 


The  -2  Log  likelihood  is  472.42.  The  model  had  a  Chi-square  value  of  96.724 
with  a  significance  level  of  .000.  Table  25  contains  the  coefficient  and  significance 
levels  for  each  of  the  independent  variables  (predictors)  in  explaining  the  reasons  for 
which  a  student  voluntarily  attrites.  Table  26  contains  the  coefficient  and  significance 
levels  for  each  of  the  independent  variables  (predictors)  in  explaining  the  reasons  for 
which  a  student  attrites  due  to  academic  difficulties.  In  explaining  why  a  student  attrites 
due  to  voluntary  reasons,  five  of  the  twelve  variables  are  significant;  four  are  significant 
at  the  five  percent  level  and  one  is  significant  at  the  ten  percent  level.  In  explaining  why 
a  student  attrites  due  to  academic  reasons,  four  of  the  twelve  variables  were  significant  at 
the  five  percent  level. 
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Table  25.  Attrite  for  Voluntary  Reasons  (Trinomial  Regression  Results) 


Variable 

Coefficient 

Significance 

Average  Difference  in  Six-Week  Grade  and 
Final  Grade 

-.873 

.018 

Average  Six- Week  Grade 

-.794 

.003 

SAT  Verbal 

.002 

.454 

SAT  Math 

.000 

.958 

Participated  in  one  MGSP  Session 

.157 

.695 

Participated  in  two  or  more  MGSP  Session 

-.943 

.051 

Participated  in  varsity  athletics  during  plebe  year 

-.279 

.444 

Gender 

1.328 

.000 

African  American 

-.923 

.159 

Hispanic 

.219 

.651 

Other  Ethnicity 

-1.055 

.322 

Assigned  to  PIP 

-1.526 

.022 

1.  Discussion  of  Variables:  Attrite  Voluntarily 

a.  Average  Difference  in  Six-Week  Grade  and  Final  Grade 

Students  with  a  large  improvement  from  the  six-week  point  in  a  course  to 

the  final  grade  are  less  likely  to  attrite.  This  variable  is  significant  at  the  five  percent 
level  (.018). 

b.  A  verage  Six-  Week  Grade 

Students  with  higher  six-week  averages  are  less  likely  to  attrite  for 
voluntary  reasons  than  those  with  high  six-week  grades.  This  variable  is  significant  at 
the  five  percent  level  (.003).  In  general,  students  who  are  more  successful  in  their 
academics  are  less  likely  to  leave  the  Naval  Academy  due  to  voluntary  reasons. 

c.  Participated  in  Two  or  More  MGSP  Sessions 

Students  who  are  active  participants  in  the  MGSP  are  less  likely  to  attrite 
for  personal  reasons.  This  variable  is  significant  at  the  ten  percent  level.  It  is  interesting 
to  note  that  students  who  only  participate  in  one  or  less  MGSP  session  are  not  less  likely 
to  attrite  for  personal  reasons.  Similar  to  academic  success  as  a  predictor  for  persistence, 
the  significance  of  participation  in  MGSP  indicates  that  students  who  become  active 
participants  in  the  learning  process  are  much  more  likely  to  persist  beyond  their  freshman 
year. 
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d.  Gender 

Women  are  more  likely  to  attrite  for  personal  reasons  than  men.  This 
variable  is  significant  at  the  five  percent  level  (.000).  In  addition,  the  relatively  large 
logit  coefficient  indicates  that  women  may  face  significant  hurdles  to  adjusting  to  a 
predominately  male,  military  institution. 

e.  Assigned  to  PIP 

Students  assigned  to  PIP  are  less  likely  to  attrite  for  personal  reasons  than 
other  at-risk  students  not  assigned  to  PIP.  This  variable  is  significant  at  the  five  percent 
level  (.022).  Again,  the  relatively  large  logit  coefficient  suggests  that  a  major  benefit  of 
the  PIP  is  assisting  at-risk  students  to  adjust  to  the  rigors  of  their  freshman  year  at  the 
Naval  Academy. 

Table  26.  Attrite  for  Academic  Reasons  (Trinomial  Regression  Results) 


Variable 

Coefficient 

Significance 

Average  Difference  in  Six-Week  Grade  and 
Final  Grade 

-1.337 

.000 

Average  Six- Week  Grade 

-1.462 

.000 

SAT  Verbal 

-.001 

.817 

SAT  Math 

.005 

.168 

Participated  in  one  MGSP  Session 

-.510 

.239 

Participated  in  two  or  more  MGSP  Session 

-1.420 

.008 

Participated  in  varsity  athletics  during  plebe  year 

-.450 

.250 

Gender 

-.278 

.606 

African  American 

.190 

.725 

Hispanic 

1.254 

.007 

Other  Ethnicity 

.314 

.698 

Assigned  to  PIP 

.371 

.404 

2.  Discussion  of  Variables:  Attrite  for  Academic  Reasons 

a.  Average  Differences  in  Six-Week  Grade  and  Final  Grade 
Students  who  had  significant  positive  change  in  their  grades  from  the  six- 

week  mark  to  their  final  grade  are  less  likely  to  attrite  for  academic  reasons.  This 
variable  is  significant  at  the  five  percent  level  (.000). 

b.  A  verage  Six-  Week  Grade 

Students  with  higher  six-week  grades  are  less  likely  to  attrite  for  academic 
reasons.  This  variable  is  significant  at  the  five  percent  level  (.000).  As  reported 
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previously,  the  significance  level  of  this  variable  indicates  the  importance  of  academic 
success  in  a  student’s  persistence  beyond  the  freshman  year. 

c.  Participation  in  Two  or  More  MGSP  Sessions 

Students  who  participate  in  two  or  more  MGSP  sessions  are  less  likely  to 
attrite  for  academic  reasons  than  those  who  do  not  participate  in  MGSP.  This  variable  is 
significant  at  the  five  percent  level  (.008).  In  addition,  the  relatively  large  logit 
coefficient  is  indicative  of  the  importance  of  attending  special  tutorials  offered  by  senior 
Midshipmen.  In  past  studies  measuring  the  impact  of  supplemental  instruction,  the  issue 
of  motivation  has  confounded  many  of  the  studies.  Survey  results  of  PIP  students  from 
AY  2002-2005  indicate  that  at-risk  students  who  persisted  are  very  motivated.  Of  the 
responders,  87%  reported  that  they  had  sought  additional  academic  assistance.  Although 
those  who  attrited  were  not  surveyed,  it  is  compelling  that  those  who  are  most  at-risk 
(PIP  participants)  had  voluntarily  sought  additional  assistance  to  such  a  degree. 

d.  Ethnic  Minorities 

Only  Hispanic  students  are  more  inclined  to  attrite  for  academic  reasons 
compared  to  Caucasians.  This  variable  is  significant  at  the  five  percent  level  (.007). 

e.  Assigned  to  PIP 

It  is  interesting  to  note  that  the  most  at-risk  students  at  the  Naval  Academy 
are  not  more  inclined  to  attrite  due  to  academic  reasons.  Though  not  statistically 
significant,  it  is  interesting  that  they  are  not  more  vulnerable  given  the  dramatic 
differences  between  PIP  participants  and  watch-list  assignees.  In  a  survey  that  is 
administered  to  PIP  participants,  56  percent  of  responders  indicated  that  the  personal 
attention  from  the  Academic  Center  staff  is  the  most  positive  aspect  of  the  PIP  program. 
Though  it  can  only  be  inferred,  the  attention  that  these  students  receive  from  the 
Academic  Center,  undoubtedly,  has  a  positive  effect  on  their  persistence  at  the  Naval 
Academy. 
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c. 


PERFORMANCE  MODEL  (DIFFERENCE  FROM  SIX-WEEKGRADE  TO 
FINAL  GRADE  AS  DEPENDANT  VARIABLE) 


In  this  model  (Ordinary  Least  Squares),  the  dependant  variable  is  the  difference  in 
a  student’s  grades  from  the  six- week  point  in  a  course  to  the  final  grade  that  is  awarded. 
Control  variables  included  demographic  variables  as  well  as  other  variables  that  were 
believed  to  be  correlated  with  academic  perfonnance.  These  variables  include:  average 
six-week  grades,  SAT  math  averages,  SAT  verbal  averages,  whether  a  student 
participated  in  one  or  less  MGSP  session,  whether  or  not  a  student  participated  in  two  or 
more  MGSP  sessions,  whether  or  not  a  student  is  an  athlete  during  his  or  her  plebe  year, 
gender,  ethnicity,  and  whether  or  not  a  student  is  assigned  to  the  PIP.  Thus,  the  model  is 
specified  as  follows: 

Difference  in  Grade  from  Six-Week  Mark  to  Final  Grade  Awarded  =/ 
(average  six-week  grades,  SAT  math  averages,  SAT  verbal 
averages,  whether  a  student  participated  in  one  MGSP  session, 
whether  or  not  a  student  participated  in  two  or  more  MGSP 
sessions,  whether  or  not  a  student  is  an  athlete  during  his  or  her 
plebe  year,  gender,  ethnicity,  and  whether  or  not  a  student  is 
assigned  to  the  PIP) 


The  R2  value  is  .177.  This  value  indicates  that  the  model  explains  only  18%  of 
the  variation.  The  F-value  for  the  model  is  10.969.  The  significance  of  the  model  is 
.000.  Table  27  contains  the  coefficient,  T-statistics,  and  significance  levels  for  each  of 
the  independent  variables  (predictors).  Of  the  eleven  independent  variables  used  in  the 
model,  five  are  significant.  Four  variables  are  significant  at  the  five  percent  level  and  one 
is  significant  at  the  ten  percent  level. 
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Table  27.  Performance  Model  (Difference  in  Six-Week  Grade  and  Final  Grade 
_ Awarded  as  Dependant  Variable) _ _ 


Variable 

Coefficient 

T-Statistic 

Significance 

Average  Six- Week  Grade 

-.242 

-8.971 

.000 

SAT  Verbal 

-2.61E-04 

-.827 

.409 

SAT  Math 

1.11E-03 

2.998 

.003 

Participated  in  one  MGSP  Session 

7.02E-03 

.148 

.882 

Participated  in  two  or  more  MGSP 
Session 

.111 

2.490 

.013 

Participated  in  varsity  athletics  during 
plebe  year 

3.16E-03 

.080 

.936 

Gender 

-6.13E-02 

-1.19 

.235 

African  American 

-8.94E-02 

-1.614 

.107 

Hispanic 

-.160 

-2.771 

.006 

Other  Ethnicity 

-.161 

-1.874 

.062 

Assigned  to  PIP 

-6.984 

-1.354 

.176 

1.  Discussion  of  the  Variables 

a.  A  verage  Six-  Week  Grade 

Students  with  lower  six-week  grades  achieved  a  gain  in  grades  over  the 
course  of  the  semester.  As  reported  previously,  the  average  change  in  grade  for  the  total 
population  was  -0.17  (on  a  4.0  grade  point  scale).  This  variable  is  significant  at  the  five 
percent  level  (.000). 

b.  SAT  Math  Score 

Students  with  higher  SAT  math  scores  improved  their  performance  from 
the  six-week  period  of  a  course  until  the  end  of  the  course.  This  variable  is  significant  at 
the  five  percent  level  (.003). 

c.  Participated  in  Two  or  More  MGSP  Sessions 

These  students  improved  their  grades  from  the  six-week  period  of  the 
course  to  the  end  of  the  course.  This  variable  is  significant  at  the  five  percent  level 
(.013).  This  variable  is  interesting  because  the  nature  of  supplemental  instruction  is  that 
improvement  in  a  particular  course  is  realized  after  attending  multiple  sessions.  In  other 
words,  students  who  attend  only  one  MGSP  session  show  no  improvement  in  grades. 
According  to  the  model,  students  who  attended  two  or  more  MGSP  sessions  averaged  an 
increase  in  grade  of  .11.  This  is  especially  significant  in  that  the  total  population 
experienced  a  decrease  of  -.17.  Similarly  to  the  findings  in  other  models  previously 
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reported,  students  who  attend  MGSP  on  a  regular  basis  will  experience  an  increase  in 
their  performance. 

d.  Ethnic  Minorities 

Only  Hispanic  students  are  less  likely  to  experience  positive  improvement 
from  the  six-week  period  in  a  course  until  the  end  of  the  course  compared  to  Caucasians. 
This  variable  is  significant  at  the  five  percent  level  (.006). 

D.  SURVEY  RESULTS 

Students  who  were  surveyed  represented  a  group  of  at-risk  students  who  persisted 
beyond  their  freshmen  year.  As  such,  their  motivation  can  be  assumed  to  be  different 
than  those  who  failed  to  persist.  The  survey  measured  motivation  in  four  areas: 
academic  motivation,  coping  skills,  social  motivation,  and  receptivity  to  support  services. 
An  additional  category  is  created  to  elicit  infonnation  about  current  academic  assistance 
programs  available  for  at-risk  students  at  the  Naval  Academy. 

1.  Academic  Motivation 

Three  questions  specifically  addressed  academic  motivation.  On  all  three 
questions,  students  provided  responses  that  are  indicative  of  high  academic  motivation. 
Table  28  is  a  summary  of  selected  statistics  from  questions  concerning  academic 
motivation.  It  is  interesting  to  note  that  only  three  percent  of  responders  arrived  at  the 
Naval  Academy  with  no  academic  goals.  Similarly,  it  is  very  interesting  that  90  percent 
of  responders  had  academic  goals  of  achieving  a  2.5  or  higher  Grade  Point  Average. 
This  is  significant  for  three  reasons:  first,  the  Naval  Academy  is  a  very  difficult 
academic  institution  and  achieving  academic  success  is  challenging;  second,  the 
minimum  requirement  for  graduation  is  a  2.0  GPA;  third,  all  of  these  students  represent 
the  most  at-risk  students  admitted  to  the  institution  and  yet  they  have  lofty  academic 
goals. 
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Table  28.  Selected  Responses  from  Survey  Data  (Academic  Motivation) 


Academic  Motivation 

Percent 

Arrived  at  the  Naval  Academy  with  goals  of  achieving  a  2.5  GPA  or  higher 

90% 

Arrived  at  the  Naval  Academy  with  no  academic  goals 

3% 

Aspires  to  earn  Master's  degree  or  higher 

82% 

Is  satisfied  with  only  earning  a  Bachelor's  degree 

18% 

2.  Coping  Skills 

At-risk  students  manage  their  learning  in  different  ways.  As  per  the  literature 
review,  many  at-risk  students  fail  to  fully  understand  the  manner  in  which  they  learn  best. 
At  the  Naval  Academy,  at-risk  students  who  persisted  appear  to  have  developed 
successful  coping  strategies  that  have  allowed  them  to  succeed  and  persist.  Table  29  is  a 
summary  of  selected  statistics  from  questions  concerning  coping  skills.  It  is  interesting  to 
note  that  51  percent  of  at-risk  students  believe  that  additional  studying  will  lead  to  an 
improvement  in  performance.  In  other  studies,  researchers  have  found  the  opposite  to  be 
true.  Because  at-risk  students  have  experienced  academic  difficulty  so  frequently,  they 
believe  that  it  is  inevitable  that  they  will  perform  poorly,  regardless  of  effort. 


T able  29.  Selected  Responses  from  Survey  Data  (Coping  Skills) 


Coping  Skills 

Percent 

Voluntarily  sought  academic  assistance 

78% 

Only  sought  academic  assistance  when 
required  to  do  so 

5% 

Willingness  to  interact  with  professors 

85% 

Believes  that  additional  studying  improves 
perfonnance 

51% 

3.  Social  Motivation 

Many  at-risk  students  fail  to  balance  social  opportunities  with  academic 
requirements.  In  college,  this  is  compounded  by  the  fact  that  there  are  fewer  controls 
than  during  a  student’s  high  school  career.  In  college,  students  must  possess  self- 
discipline  in  order  to  hannonize  social  opportunities  and  academic  requirements.  For  the 
students  surveyed,  they  appear  to  have  found  a  healthy  balance  between  socializing  and 
studies.  Table  30  is  a  summary  of  selected  statistics  from  questions  concerning  social 
motivation.  Of  the  students  surveyed,  64%  reported  that  they  routinely  complete 
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academic  requirements  instead  of  participating  in  extra-curricular  activities.  In  addition, 
not  a  single  responder  indicated  that  he  or  she  routinely  choose  to  participate  in  extra¬ 
curricular  activities  at  the  expense  of  his  or  her  academic  requirements. 

Table  30.  Selected  Responses  from  Survey  Data  (Social  Motivation) 


Social  Motivation 

Percent 

Maintain  healthy  balance  between  non-academic  activities  and  academic  requirements 

71% 

Allow  non-academic  activities  to  take  precedence  over  academic  requirements 

7% 

Routinely  complete  academic  requirements  instead  of  participating  in  extra-curricular 
activities 

64% 

Routinely  chooses  to  participate  in  extra-curricular  activities  instead  of  fulfilling 
academic  requirements 

0% 

4.  Receptivity  to  Support  Services 

As  discussed  in  the  literature  review,  many  at-risk  students  do  not  succeed 
because  they  fail  to  seek  assistance.  Table  31  is  a  summary  of  selected  statistics  from 
questions  concerning  coping  skills.  It  is  interesting  to  note  that  59  percent  of  at-risk 
students  were  willing  participants  in  the  PIP.  Similarly,  it  is  also  interesting  that  only 
three  percent  did  not  want  to  participate  in  the  program. 

Table  31.  Selected  Responses  from  Survey  Data  (Receptivity  to  Support 

Services) 


Receptivity  to  Support  Services 

Percent 

Believed  that  they  would  need  academic  assistance 

56% 

Is  a  willing  participant  in  the  PIP 

59% 

Is  not  a  willing  participant  in  the  PIP 

3% 

5.  Evaluation  of  Academic  Assistance  Programs 

Included  in  the  survey  is  a  series  of  questions  that  allowed  responders  to  evaluate 
two  academic  assistance  programs  at  the  Naval  Academy:  the  PIP  and  MGSP.  Table  32 
summarizes  the  evaluation  of  the  PIP.  Table  33  summarizes  the  evaluation  of  the  MGSP. 

a.  PIP 

Students  in  the  PIP  believe  that  the  relationships  formed  with  the 
academic  advisors  are  crucial  to  the  program’s  success.  In  addition,  many  enrolled  in  the 
program  enjoy  that  the  focus  is  on  general  study  skills.  Similarly,  however,  a  percentage 
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of  responders  believe  that  the  program  could  be  improved  if  more  content-specific 
instruction  could  be  provided. 

Table  32.  Summary  of  PIP  Evaluation 


PIP 

Percent 

Strength  of  the  program  is  the  relationship  formed  with 
academic  adviser 

56% 

The  program  is  helpful  because  it  focuses  on  general  study  skills 

32% 

A  weakness  in  the  program  is  that  it  is  not  content  specific 

39% 

The  schedule  of  the  program  is  not  convenient 

27% 

b.  MGSP 

Although  some  responders  believe  that  the  program  improves 
performance,  others  do  not.  It  is  interesting  to  note,  however,  that  the  quantitative 
analysis  of  the  data  indicates  that  continued  participation  in  MGSP  sessions  improves 
performance  and  also  increases  the  likelihood  of  persistence.  Other  responders  indicated 
that  they  thought  the  MGSP  leaders  were  effective,  while  others  believed  that  the  quality 
of  the  MGSP  leaders  needs  to  improve. 

Table  33.  Summary  of  MGSP  Evaluation 


MGSP 

Percent 

Program  could  be  improved  if  more  instructors  were  available  at 
individual  sessions 

12% 

Program  assists  in  improving  academic  performance 

33% 

Program  does  not  improve  my  academic  performance 

28% 

MGSP  leaders  are  effective 

16% 

Competency  of  instructors  needs  to  improve 

10% 

Environment  of  MGSP  should  be  improved  (location,  frequency) 

17% 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  RESULTS 

The  primary  goal  of  this  thesis  is  to  examine  the  impact  of  academic  assistance 
programs  at  the  United  States  Naval  Academy  on  at-risk  students.  Three  areas  were 
explored:  the  characteristics  of  at-risk  students,  the  effect  of  academic  assistance 
programs  on  at-risk  retention  and  persistence,  and  the  impact  of  academic  assistance 
programs  on  at-risk  academic  performance.  The  following  section  provides  analysis  on 
the  four  primary  research  questions  that  were  posed  earlier  in  the  thesis. 

1.  What  are  the  differences  between  students  selected  for  inclusion  in  the 
PIP  as  opposed  to  those  assigned  to  the  watch-list? 

According  to  the  model,  the  fundamental  differences  in  those  who  are  assigned  to 
the  PIP  compared  with  those  assigned  to  the  watch-list  include:  lower  SAT  math  scores, 
lower  RAB  scores,  lower  WPM  scores,  and  PIP  participants  are  much  more  likely  to  be 
recruited  athletes  than  watch-list  students. 

2.  What  is  the  impact  of  selected  academic  assistance  programs  on 
whether  or  not  an  at-risk  student  attrites  at  the  Naval  Academy 
during  his  or  her  freshman  year? 

According  to  the  second  model,  at-risk  students  who  participate  in  the  PIP  at  the 
Naval  Academy  are  less  vulnerable  to  attrition  than  those  who  do  not.  In  addition, 
students  who  regularly  participate  in  MGSP  sessions  are  much  more  likely  to  persist  to 
their  sophomore  year  than  those  who  do  not. 

3.  Do  students  solely  enrolled  in  PIP  experience  greater  academic 
improvement  than  other  PIP  students  who  also  participate  in  MGSP? 

According  to  the  third  model,  students  who  participate  in  MGSP,  regardless  of 
enrollment  in  other  academic  assistance  programs,  perform  better  academically.  It 
should  also  be  noted,  however,  that  regular  attendance  in  MGSP  sessions  is  critical  to  a 
student’s  improvement. 
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4.  What  is  the  impact  of  motivation  on  the  performance  of  at-risk 
students? 

The  students  who  were  surveyed  represent  the  most  at-risk  students  at  the  Naval 
Academy.  It  is  clear  that  their  persistence  is  due  to  their  successful  motivation  in  the 
following  areas:  academic  motivation,  coping  skills,  social  motivation,  and  receptivity  to 
support  services. 

B.  RECOMMENDATIONS 

The  results  of  the  research  indicate  that  at-risk  students  at  the  Naval  Academy  are 
capable  of  achieving  academic  success  if  provided  with  appropriate  levels  of  assistance. 
Although  existing  programs  are  successful,  there  are  a  number  of  changes  and/or 
modifications  that  can  be  made  to  improve  the  retention  and  academic  performance  of  at- 
risk  students. 

1.  Motivation  Survey 

Although  the  current  admissions  process  at  the  Naval  Academy  should  be 
continued,  there  is  one  significant  change  that  must  be  made:  at-risk  students  must  be 
surveyed  prior  to  being  accepted.  The  results  of  the  survey  indicate  that  the  group  of  at- 
risk  students  still  in  attendance  at  the  Naval  Academy  represent  highly  motivated 
learners.  It  is  impossible  to  characterize  students  who  attrited  as  “unmotivated”  because 
they  were  not  available  to  be  surveyed.  It  is  possible,  however,  to  assume  that  students 
who  attrited  were  less  motivated  than  those  who  persisted.  As  part  of  the  admissions 
process  at  the  Naval  Academy,  applicants  with  questionable  entrance  qualifications  (i.e., 
candidates  for  the  PIP)  should  be  subject  to  an  academic  motivation  survey  prior  to 
acceptance.  It  only  makes  sense  that  the  Naval  Academy  afford  the  opportunity  to  attend 
the  institution  to  those  who  are  committed.  There  exist  a  number  of  academic  motivation 
surveys  that  could  be  administered  to  applicants  in  a  timely  manner.  Although  there  is  a 
cost  associated  with  administering  the  survey,  these  costs  represent  only  a  fraction  of  the 
cost  of  one  student  who  attrites. 

2.  Continue  PIP 

As  an  academic  assistance  program,  the  PIP  is  a  very  successful  program.  The 
support  that  the  at-risk  students  receive  from  the  Academic  Center  staff  is  unquestionably 
positive  and  has  a  tremendous  impact  on  retention.  Although  PIP  students  represent  the 
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most  susceptible  students  at  the  Naval  Academy,  they  are  no  more  likely  to  attrite  than 
others  with  higher  qualifications  (watch-list  students).  Although  the  quantitative  analysis 
indicates  as  much,  it  is  the  results  of  the  survey  that  clearly  demonstrate  the  impact  of  the 
program. 

3.  Mandate  MGSP  for  At-Risk  Students 

Although  the  PIP  is  a  successful  program,  it  must  be  modified  to  include 
mandatory  MGSP  attendance.  The  results  of  the  quantitative  analysis  clearly  indicate 
that  students  who  are  active  participants  in  the  program  are  far  more  likely  to  persist.  In 
addition,  regular  attendance  at  MGSP  sessions  leads  to  academic  improvement.  The  PIP 
can  become  a  very  effective  program  if  it  maximizes  the  MGSP. 

4.  Improve  MGSP  Leaders 

On  a  whole,  MGSP  is  a  very  successful  program  and  must  be  expanded.  Results 
of  the  quantitative  analysis  indicate  that  regular  attendance  leads  to  an  improvement  in 
academic  performance  for  all  students,  let  alone  at-risk  students.  Despite  the  success  of 
the  program,  there  are  changes  that  need  to  be  made  to  the  program.  Survey  results 
indicate  that  MGSP  leaders  must  be  improved.  Despite  the  fact  that  there  already  exists 
an  extensive  MGSP  development  program,  perhaps  even  more  of  an  emphasis  on  leader 
development  must  occur.  Additional  data  should  be  collected  to  determine  the 
appropriate  changes  to  be  made  to  the  leadership  development  aspect  of  the  program. 

C.  RECOMMENDATIONS  FOR  FUTURE  RESEARCH 

This  thesis  examined  the  impact  of  academic  assistance  programs  on  at-risk 
students  at  the  Naval  Academy.  Although  results  were  revealed,  there  arose  a  number  of 
topics  that  could  be  explored  through  future  research. 

•  Repeat  the  study  using  the  entire  brigade  of  Midshipmen.  This  study 
analyzed  only  those  students  selected  for  the  PIP  and  the  watch-list.  It  is 
unclear  if  the  results  would  remain  consistent  if  analyzing  the  larger 
population. 


•  MGSP,  despite  its  proven  success,  is  largely  unattended  by  the  majority  of 
students.  Those  who  do  attend,  do  not  appear  to  attend  with  much 
regularity.  It  is  proven,  however,  that  regular  attendance  significantly 
improves  academic  performance.  Future  research  could  analyze 
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Midshipmen  views  toward  MGSP  in  determining  whether  or  not  one 
chooses  to  attend. 


In  this  study,  only  technical  core  courses  were  analyzed.  Future  research 
could  analyze  the  academic  improvement  in  other  core  courses. 


APPENDIX  A:  ACADEMIC  SURVEY 


Academic  Enthusiasm  Survey 

This  survey  is  designed  to  measure  an  individual ’s  academic  enthusiasm. 
Although  each  Midshipman  that  has  received  this  survey  has  been  personally 
selected  based  on  his/her  participation  in  the  Plebe  Intervention  Program  (PIP), 
your  responses  will  be  confidential. 

1 .  When  I  arrived  at  the  Naval  Academy,  I  believed  that  I  would  need  academic 
assistance. 

1.  Strongly  Disagree  (5.1%) 

2.  Disagree  (19.2%) 

3.  Neither  Disagree  or  Agree  (19.2%) 

4.  Agree  (39.4%) 

5.  Strongly  Agree  (17.2%) 

2.  The  three  most  beneficial  aspects  of  the  Plebe  Intervention  Program  are: 

a.  Personal  attention  from  my  advisor.  (43%) 

b.  The  focus  of  the  program  is  on  general  study  skills,  not  content  specific 
matter.  (32%) 

c.  The  relationships  that  are  formed  between  me  and  my  advisor.  (13%) 

d.  Other-(please  specify)  (12%) 

Trends:  1.  Resources  were  available  to  help  out  struggling 
students  (3  out  of  12  responses). 

2.  No  benefit  (5  out  of  12  responses) 

3.  The  three  least  beneficial  aspects  of  the  Plebe  Intervention  Program  are: 

a.  I  do  not  like  the  personal  attention.  (7.1%) 

b.  I  do  not  like  the  advisors.  (2.0%) 

c.  The  program  does  not  focus  on  any  particular  courses.  (38.8%) 

d.  The  schedule  is  not  convenient  for  me.  (26.5%) 

e.  Other-(please  specify)  (25.5%) 

Trends:  1.  Nothing  consistent 

4.  I  have  sought  formal  academic  assistance  (El,  MGSP,  Tutoring) 

1 .  When  required  by  a  professor,  Company  Officer,  Coach,  Officer 
Representative,  or  another  authority  figure.  (5%) 

2.  When  suggested  by  a  professor,  Company  Officer,  Coach,  Officer 
Representative,  or  another  authority  figure.  (7%) 

3.  Voluntarily  (87%) 

4.  Never  (1%) 

5.  When  assigned  to  the  Plebe  Intervention  Program,  I  welcomed  the  assistance. 
1.  Strongly  Disagree  (3%) 
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2.  Disagree  (13%) 

3.  Neither  Disagree  or  Agree  (25%) 

4.  Agree  (41%) 

5 .  Strongly  Agree  ( 1 8  %) 

6.  I  learn  better  in  group  settings. 

1.  Strongly  Disagree  (6%) 

2.  Disagree  (33%) 

3.  Neither  Disagree  or  Agree  (31%) 

4.  Agree  (23%) 

5.  Strongly  Agree  (7%) 

7.  When  I  arrived  at  the  Naval  Academy,  my  goals  were: 

1.  4.0  (3%) 

2.  3. 5-3. 9  (8%) 

3.  3. 0-3 .4  (46%) 

4.  2. 5-2. 9  (33%) 

5.  2. 0-2.4  (7%) 

6.  Under  2.0  (0%) 

7.  No  goals  (3%) 

8.  My  educational  goals  are: 

1.  Bachelor’s  degree  (18%) 

2.  Master’s  degree  (69%) 

3.  Doctorate  degree  (13%) 

9.  I  have  seriously  contemplated  leaving  the  Naval  Academy. . . 

1.  Strongly  Disagree  (34%) 

2.  Disagree  (23%) 

3.  Neither  Disagree  or  Agree  (15%) 

4.  Agree  (15%) 

5.  Strongly  Agree  (13%) 

10. 1  find  that  group  study  sessions  are  productive. 

1.  Strongly  Disagree  (3%) 

2.  Disagree  (19.2) 

3.  Neither  Disagree  or  Agree  (30.3%) 

4.  Agree  (42.4%) 

5.  Strongly  Agree  (5.1%) 

1 1 . 1  have  found  that  increasing  my  academic  effort  greatly  improves  my 
academic  performance. 

1.  Strongly  Disagree  (5%) 

2.  Disagree  (5%) 

3.  Neither  Disagree  or  Agree  (16%) 

4.  Agree  (50%) 
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5.  Strongly  Agree  (24%) 

12.  Being  involved  in  non-academic  activities  is  more  important  to  me  than 
achieving  academic  excellence. 

1.  Strongly  Disagree  (15%) 

2.  Disagree  (25%) 

3.  Neither  Disagree  or  Agree  (35%) 

4.  Agree  (22%) 

5.  Strongly  Agree  (3%) 

13.  When  managing  my  time,  I  typically: 

1 .  Focus  solely  on  my  academic  requirements  and  do  not  allow  any 
distractions  (social  functions/EC  A/Sports)  to  interfere.  (11%) 

2.  Do  only  what  is  academically  required.  (11%) 

3.  Maintain  a  healthy  balance  between  non-academic  activities  and  academic 
requirements.  (71%) 

4.  Allow  non-academic  activities  to  take  precedence  over  academic 
requirements.  (7%) 

14. 1  have  difficulty  choosing  to  complete  academic  requirements  instead  of 
participating  in  athletic  requirements. 

1.  Strongly  Disagree  (8%) 

2.  Disagree  (41%) 

3.  Neither  Disagree  or  Agree  (31%) 

4.  Agree  (19%) 

5.  Strongly  Agree  (1%) 

15.1  have  difficulty  choosing  to  complete  academic  requirements  instead  of 
participating  in  extra-curricular  activities. 

1.  Strongly  Disagree  (12%) 

2.  Disagree  (52%) 

3.  Neither  Disagree  or  Agree  (27%) 

4.  Agree  (9%) 

5.  Strongly  Agree  (0%) 

16. 1  have  difficulty  choosing  to  complete  academic  requirements  instead  of 
participating  in  military  obligations. 

1.  Strongly  Disagree  (9%) 

2.  Disagree  (47%) 

3.  Neither  Disagree  or  Agree  (27%) 

4.  Agree  (16%) 

5.  Strongly  Agree  (1%) 

17. 1  tend  to  put  off  my  assignments  until  they  are  due. 

1.  Strongly  Disagree  (11%) 

2.  Disagree  (28%) 
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3.  Neither  Disagree  or  Agree  (17%) 

4.  Agree  (38%) 

5.  Strongly  Agree  (6%) 

18. 1  feel  free  to  interact  with  my  professors. 

1.  Strongly  Disagree  (1%) 

2.  Disagree  (4%) 

3.  Neither  Disagree  or  Agree  (10%) 

4.  Agree  (64%) 

5.  Strongly  Agree  (21%) 

19.  A  lot  of  studying  on  my  part  does  not  improve  my  perfonnance. 

1 .  Strongly  Disagree  ( 1 0%) 

2.  Disagree  (41%) 

3 .  Neither  Disagree  or  Agree  ( 1 9%) 

4.  Agree  (21%) 

5.  Strongly  Agree  (9%) 

20. 1  have  participated  in  the  Midshipmen  Study  Group  Program  (MGSP)  in  the 
following  courses  (select  more  than  one  if  applicable). 

1.  Chemistry  I  (79%) 

2.  Chemistry  II  (66%) 

3.  Physics  I  (36%) 

4.  Physics  II  (23%) 

5.  Calculus  I  (38%) 

6.  Calculus  II  (23%) 

7.  Calculus  III  (21%) 

8.  Other  (8%) 

21.  If  you  have  participated  in  MGSP,  the  three  most  appealing  aspects  of  MGSP 
that  caused  me  to  participate  are: 

a.  Environment  (8.9%) 

b.  Learning  from  peers  (18.9%) 

c.  The  MGSP  Leader  (15.6%) 

d.  It  assists  in  improving  my  academic  performance.  (33.3%) 

e.  The  location  of  the  MGSP  sessions  are  convenient.  (6.7%) 

f.  Other-(please  specify)  (16.7%) 

Trends:  1.  Showed  the  instructor  that  the  student  was 
putting  forth  the  effort  (4  of  15  responses). 

22.  If  you  have  not  participated  in  MGSP,  the  three  least  appealing  aspects  of 
MGSP  that  caused  me  not  to  participate  are: 

a.  I  do  not  like  the  environment.  (23.9%) 

b.  I  do  not  like  learning  from  peers.  (15.2%) 

c.  It  does  not  improve  my  academic  performance.  (28.3%) 

d.  The  location  of  the  MGSP  sessions  are  not  convenient.  (8.7%) 
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f.  Other-  (please  specify)  (23.9%) 

Trends:  1.  None — only  8  responses. 

23.  The  three  changes  that  could  be  made  to  MGSP  to  increase  participation  are: 

a. 

b. 

c. 


Trends:  59/100  respondents  responded  to  this  question. 

Leaders: 

1.  Not  enough  per  session  (12  responses) 

2.  Competency  of  the  instructors  needs  to  improve  (10  responses) 
Lack  Interaction  Between  Profs  and  MGSP  Leader  (5  responses) 
Professors 

1.  Should  be  available  at  sessions  (6  responses) 

2.  Should  grant  extra  credit  for  attendance  (6  responses) 

Space/Environment 

1.  MGSP  sessions  should  be  in  Bancroft  Hall  (7  responses) 

2.  MGSP  sessions  need  to  be  offered  more  often  (6  responses) 

3.  Snacks  should  be  allowed/offered  (4  responses) 
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APPENDIX  B:  SPSS  OUTPUT 


PIP  Model  (Logistic  Regression) 


Case  Processing  Summary 


Unweighted 

Cases(a) 

N 

Percent 

Selected  Cases 

Included  in 
Analysis 

909 

100 

Missing  Cases 

0 

0 

Total 

909 

100 

Unselected 

Cases 

0 

0 

Total 

909 

100 

a.  If  weight  is  in  effect,  see  classification  table  for  the  total  number  of  cases 


Dependent  Variable  Encoding 


Original 

Value 

Internal 

Value 

0 

0 

1 

1 

Block  1:  Method=Enter 


Omnibus  Tests  of  Model  Coefficients 


Chi- 

square 

df 

Sig. 

Step  1 

Step 

88.28904 

9 

3.55E- 

15 

Block 

88.28904 

9 

3.55E- 

15 

Model 

88.28904 

9 

3.55E- 

15 

Model  Summary 


Step 

-2  Log 
likelihood 

Cox  & 
Snell  R 
Square 

Nagelkerke 
R  Square 

1 

775.8801 

0.09256 

0.150866 
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Classification  Table  (a) 


Observed 

Predicted 

PIP 

Percentage 

Correct 

0 

1 

Step  1 

PIP 

0 

476 

267 

64.0646 

1 

50 

116 

69.87952 

Overall 

Percentage 

65.12651 

a.  The  cut  value  is  .180 


Variables  in  the  Equation 


B 

S.E. 

Wald 

df 

Sig. 

Exp(B) 

Step 

1(a) 

SAMVAVG 

0.001946 

0.001626 

1.432881 

1 

0.231295 

1.001948 

SATMAVG 

-0.01218 

0.002318 

27.594 

1 

1.5E-07 

0.987895 

GENDER2 

0.020503 

0.239248 

0.007344 

1 

0.931706 

1.020715 

AFRICANA 

0.018243 

0.250917 

0.005286 

1 

0.942041 

1.01841 

HISPANIC 

-0.16752 

0.297037 

0.318055 

1 

0.572779 

0.845761 

OTHERETH 

-0.3043 

0.51735 

0.345973 

1 

0.556402 

0.737638 

CM  1000 

-0.10233 

0.043295 

5.586662 

1 

0.018098 

0.902729 

RAB500 

-0.06329 

0.031176 

4.121419 

1 

0.042344 

0.938669 

BLUE 

0.962781 

0.198456 

23.53578 

1 

1.23E-06 

2.61897 

Constant 

10.26172 

2.787848 

13.54885 

1 

0.000232 

28616.03 

a.  Variable(s)  entered  on  step  1:  SAMVAVG,  SATMAVG,  GENDER2,  AFRICANA, 


HISPANIC,  OTHERETH,  CM  1000,  RAB500,  BLUE. 


Attrition  Model  (Nominal  Regression) 


Case  Processing  Summary 


N 

Marginal 

Percentage 

LVREASON  Reason  For 
Leaving 

1 

Voluntary 

40 

6.980803 

3 

Academic 

39 

6.806283 

72 


9 

494 

86.21291 

Valid 

573 

100 

Missing 

317 

Total 

890 

Subpopulation 

573 

a.  The  dependent  variable  has  only  one  value  observed  in  573  (100.0%)  subpopulations. 


Model  Fitting  Information 


Model 

-2  Log 
Likelihood 

Chi- 

Square 

df 

Sig. 

Intercept 

Only 

569.1418 

Final 

472.4175 

96.72429 

24 

1.08E- 

10 

Pseudo  R-Square 


Cox  and 
Snell 

0.155325 

Nagelkerke 

0.24669 

McFadden 

0.169948 

Likelihood  Ratio  Tests 


Effect 

-2  Log 
Likelihood 
of 

Reduced 

Model 

Chi- 

Square 

df 

Sig. 

Intercept 

473.6615 

1.244047 

2 

0.536857 

SAMVAVG 

473.0688 

0.651279 

2 

0.722065 
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SATMAVG 

474.3428 

1.925285 

2 

0.381882 

AVG6WK 

506.7963 

34.37878 

2 

3.43E-08 

AVGDIF 

489.6457 

17.22824 

2 

0.000182 

MSGONE 

474.1538 

1.736295 

2 

0.419728 

MSGTWOMO 

484.2089 

11.79139 

2 

0.002751 

VARPLEBE 

474.1608 

1.743299 

2 

0.418261 

GENDER2 

485.0717 

12.65425 

2 

0.001787 

AFRICANA 

475.0044 

2.586934 

2 

0.274318 

HISPANIC 

479.1759 

6.758406 

2 

0.034075 

OTHERETH 

473.9261 

1.508636 

2 

0.470331 

PIP 

480.6139 

8.196452 

2 

0.016602 

The  chi-square  statistic  is  the  difference  in  -2  log-likelihoods  between  the  final  model  and 
a  reduced  model.  The  reduced  model  is  formed  by  omitting  an  effect  from  the  final 
model.  The  null  hypothesis  is  that  all  parameters  of  that  effect  are  0. 


Parameter  Estimates 


LVREASON 
Reason  For 
Leaving(a) 

B 

Std. 

Error 

Wald 

df 

Sig. 

1  Voluntary 

Intercept 

-1.7645 

2.302767 

0.58714 

1 

0.443527 

SAMVAVG 

0.002178 

0.002912 

0.559502 

1 

0.454461 

SATMAVG 

-0.00019 

0.003555 

0.002734 

1 

0.958299 

AVG6WK 

-0.7936 

0.269814 

8.651066 

1 

0.003269 

AVGDIF 

-0.873 

0.367737 

5.635775 

1 

0.017598 

MSGONE 

0.157253 

0.400558 

0.154123 

1 

0.694626 

MSGTWOMO 

-0.94285 

0.48405 

3.794062 

1 

0.051435 

VARPLEBE 

-0.27884 

0.364368 

0.585648 

1 

0.444107 

GENDER2 

1.328021 

0.375025 

12.53974 

1 

0.000398 

AFRICANA 

-0.92282 

0.65482 

1.986038 

1 

0.158756 

HISPANIC 

0.219087 

0.484473 

0.204501 

1 

0.651112 

OTHERETH 

-1.05482 

1.064814 

0.981319 

1 

0.321873 

PIP 

-1.52639 

0.667079 

5.235721 

1 

0.022128 

3  Academic 

Intercept 

-2.2495 

2.573061 

0.764313 

1 

0.381982 

SAMVAVG 

-0.00072 

0.003103 

0.053637 

1 

0.816851 

SATMAVG 

0.005322 

0.00386 

1.900367 

1 

0.168037 

AVG6WK 

-1.46206 

0.293407 

24.83074 

1 

6.26E-07 

AVGDIF 

-1.33713 

0.367038 

13.27159 

1 

0.000269 

MSGONE 

-0.50981 

0.433121 

1.385455 

1 

0.239174 

MSGTWOMO 

-1.41983 

0.532543 

7.108316 

1 

0.007673 

VARPLEBE 

-0.45018 

0.391463 

1.32247 

1 

0.250149 

GENDER2 

-0.27811 

0.538903 

0.266323 

1 

0.605809 
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AFRICANA 

0.189558 

0.539849 

0.123294 

1 

0.72549 

HISPANIC 

1.25399 

0.468738 

7.156952 

1 

0.007467 

OTHERETH 

0.314344 

0.809433 

0.150817 

1 

0.697756 

PIP 

0.371306 

0.445189 

0.695625 

1 

0.404258 

a.  The  reference  category  is  9. 


Performance  Model  (Ordinary  Least  Squares  Model) 


Variables  Entered/Removed  (b) 


Model 

Variables  Entered 

Variables 

Removed 

Method 

1 

PIP,  MSGTWOMO,  GENDER2,  OTHERETH, 
HISPANIC,  SAMVAVG,  VARPLEBE,  AFRICANA 
African  American,  MSGONE,  AVG6WK, 

SATMAVG(a) 

Enter 

a.  All  requested  variables  entered. 


b.  Dependent  Variable:  AVGDIF 


Model  Summary 


Model 

R 

R 

Square 

Adjusted 

R 

Square 

Std. 

Error  of 
the 

Estimate 

1 

0.420727 

0.177012 

0.160875 

0.442779 

a.  Predictors:  (Constant),  PIP,  MSGTWOMO,  GENDER2,  OTHERETH, 
HISPANIC,  SAMVAVG,  VARPLEBE,  AFRICANA  African  American, 
MSGONE,  AVG6WK,  SATMAVG 


Coefficients  (a) 


Model 

Unstandardized 

Coefficients 

Standardized 

Coefficients 

t 

Sig. 

B 

Std. 

Error 

Beta 

1 

(Constant) 

-0.0211 

0.25119 

-0.084 

0.933086 
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AVG6WK 

-0.24178 

0.026952 

-0.39135 

-8.97086 

4.39E-18 

SAMVAVG 

-0.00026 

0.000316 

-0.03462 

-0.82653 

0.408856 

SATMAVG 

0.001111 

0.00037 

0.132176 

2.9982 

0.002836 

MSGTWOMO 

0.111319 

0.044708 

0.105647 

2.489935 

0.013065 

MSGONE 

0.007018 

0.047434 

0.006259 

0.147953 

0.882433 

VARPLEBE 

0.003163 

0.039431 

0.00325 

0.080206 

0.936102 

GENDER2 

-0.06133 

0.051536 

-0.04641 

-1.18996 

0.234564 

AFRICANA 
African  American 

-0.08943 

0.055392 

-0.06738 

-1.61441 

0.107001 

HISPANIC 

-0.16049 

0.057912 

-0.11271 

-2.77125 

0.005769 

OTHERETH 

-0.16054 

0.085687 

-0.07287 

-1.87362 

0.061503 

PIP 

-0.06984 

0.051578 

-0.05696 

-1.35411 

0.176247 

a.  Dependent  Variable:  AVGDIF 
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